-- Logs begin at Wed 2022-08-24 06:58:56 UTC, end at Wed 2022-08-24 08:03:54 UTC. -- Aug 24 07:31:49.950128 dv-cinder-854273-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 07:31:49.959746 dv-cinder-854273-1-iscsi devstack@n-api.service[112127]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 07:31:49.961721 dv-cinder-854273-1-iscsi devstack@n-api.service[112127]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 07:31:49 2022] *** Aug 24 07:31:49.961721 dv-cinder-854273-1-iscsi devstack@n-api.service[112127]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 07:31:49.961721 dv-cinder-854273-1-iscsi devstack@n-api.service[112127]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 07:31:49.961721 dv-cinder-854273-1-iscsi devstack@n-api.service[112127]: nodename: dv-cinder-854273-1-iscsi Aug 24 07:31:49.961721 dv-cinder-854273-1-iscsi devstack@n-api.service[112127]: machine: x86_64 Aug 24 07:31:49.961721 dv-cinder-854273-1-iscsi devstack@n-api.service[112127]: clock source: unix Aug 24 07:31:49.961721 dv-cinder-854273-1-iscsi devstack@n-api.service[112127]: pcre jit disabled Aug 24 07:31:49.961721 dv-cinder-854273-1-iscsi devstack@n-api.service[112127]: detected number of CPU cores: 4 Aug 24 07:31:49.961721 dv-cinder-854273-1-iscsi devstack@n-api.service[112127]: current working directory: / Aug 24 07:31:49.962324 dv-cinder-854273-1-iscsi devstack@n-api.service[112127]: detected binary path: /usr/bin/uwsgi-core Aug 24 07:31:49.962324 dv-cinder-854273-1-iscsi devstack@n-api.service[112127]: your processes number limit is 47680 Aug 24 07:31:49.962324 dv-cinder-854273-1-iscsi devstack@n-api.service[112127]: your memory page size is 4096 bytes Aug 24 07:31:49.962324 dv-cinder-854273-1-iscsi devstack@n-api.service[112127]: detected max file descriptor number: 2048 Aug 24 07:31:49.962324 dv-cinder-854273-1-iscsi devstack@n-api.service[112127]: lock engine: pthread robust mutexes Aug 24 07:31:49.962324 dv-cinder-854273-1-iscsi devstack@n-api.service[112127]: thunder lock: enabled Aug 24 07:31:49.962324 dv-cinder-854273-1-iscsi devstack@n-api.service[112127]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 07:31:49.962324 dv-cinder-854273-1-iscsi devstack@n-api.service[112127]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 07:31:50.000504 dv-cinder-854273-1-iscsi devstack@n-api.service[112127]: Python main interpreter initialized at 0x55c89af079c0 Aug 24 07:31:50.000504 dv-cinder-854273-1-iscsi devstack@n-api.service[112127]: python threads support enabled Aug 24 07:31:50.000504 dv-cinder-854273-1-iscsi devstack@n-api.service[112127]: your server socket listen backlog is limited to 100 connections Aug 24 07:31:50.000504 dv-cinder-854273-1-iscsi devstack@n-api.service[112127]: your mercy for graceful operations on workers is 90 seconds Aug 24 07:31:50.000832 dv-cinder-854273-1-iscsi devstack@n-api.service[112127]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 07:31:50.000915 dv-cinder-854273-1-iscsi devstack@n-api.service[112127]: *** Operational MODE: preforking *** Aug 24 07:31:50.001153 dv-cinder-854273-1-iscsi devstack@n-api.service[112127]: *** uWSGI is running in multiple interpreter mode *** Aug 24 07:31:50.001153 dv-cinder-854273-1-iscsi devstack@n-api.service[112127]: spawned uWSGI master process (pid: 112127) Aug 24 07:31:50.001338 dv-cinder-854273-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 07:31:50.002723 dv-cinder-854273-1-iscsi devstack@n-api.service[112127]: spawned uWSGI worker 1 (pid: 112128, cores: 1) Aug 24 07:31:50.002723 dv-cinder-854273-1-iscsi devstack@n-api.service[112127]: spawned uWSGI worker 2 (pid: 112129, cores: 1) Aug 24 07:31:50.002723 dv-cinder-854273-1-iscsi devstack@n-api.service[112127]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 07:31:50.651301 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 07:31:50.660120 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 07:31:51.722877 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 07:31:51.722877 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: from cryptography.utils import int_from_bytes Aug 24 07:31:51.723520 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 07:31:51.723520 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: from cryptography.utils import int_from_bytes Aug 24 07:31:51.726060 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 07:31:51.726060 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: from cryptography.utils import int_from_bytes Aug 24 07:31:51.726532 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 07:31:51.726532 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: from cryptography.utils import int_from_bytes Aug 24 07:31:54.218420 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 07:31:54.219015 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 07:31:54.219206 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 07:31:54.219559 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 07:31:54.219814 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 07:31:54.220198 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.220524 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.220844 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.221162 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.221487 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.221623 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 07:31:54.221985 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.222077 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 07:31:54.222157 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.222397 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 07:31:54.222484 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.222733 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.222837 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 07:31:54.222998 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.223086 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 07:31:54.223312 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.223420 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.223634 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854273-1-iscsi {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.223824 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.223953 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.224153 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.224263 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.224478 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.224574 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.224812 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.224898 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.225128 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.225213 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.225458 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.225556 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.225756 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.225850 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.226099 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.226253 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.226365 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.226678 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.227005 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.227105 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854273-1-iscsi {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.227318 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.227428 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.227631 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.227729 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.227941 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.228081 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.228257 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.228374 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.228568 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.228656 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.228884 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.228978 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.229193 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.229288 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.229513 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.229705 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.229825 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.230021 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.230220 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854273-1-iscsi {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.230332 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.230539 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.230633 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.230881 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.231002 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.231742 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.231862 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.232159 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.232249 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.232471 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.232568 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.232783 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.232870 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.233104 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.233213 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.233415 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.233501 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.233718 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.233824 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854273-1-iscsi {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.234051 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.234139 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.234371 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.234471 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.234711 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.234802 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.235037 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.235127 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.235343 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.235492 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.235651 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.235740 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.235960 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.236054 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.236281 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.236450 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.236589 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.236729 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.236895 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.236989 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.237147 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.237290 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.237455 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.237617 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.237777 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.237944 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.238099 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.238254 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.238422 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.238567 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.238676 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.238910 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.239015 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.239255 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.239347 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.239577 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.239666 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.239884 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.239984 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.240149 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.240234 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.240462 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.240549 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.240775 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.240861 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.241081 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.241175 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.241387 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.241481 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.241651 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.241738 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.241908 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.242003 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.242231 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.242328 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.242556 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.242656 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.242895 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.242996 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.243207 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.243303 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.243519 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.243607 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.243830 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.243918 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.244142 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.244231 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.244445 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.244530 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.244753 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.244846 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.245065 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.245153 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.245382 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.245469 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.245700 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.245801 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.246016 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.246103 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.246322 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.246408 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.246627 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.246742 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.246982 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.247081 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.247303 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.247397 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.247629 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.247730 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.247934 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.248027 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.248186 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.248276 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.248485 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.248584 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.248788 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.248882 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.249107 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.249195 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.249413 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.249510 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.249718 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.249804 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.250022 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.250108 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.250322 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.250417 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.250624 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.250781 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.250953 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.251042 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.251259 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.251358 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.251564 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.251651 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.251868 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.251962 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.252170 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.252270 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.252474 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.252568 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.252777 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.252863 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.253079 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.253175 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.253380 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.253466 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.253691 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.253777 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.253996 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.254084 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.254301 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.254395 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.254602 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.254716 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.254933 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.255023 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.255251 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.255345 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.255557 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.255682 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.255861 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.255963 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.256177 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.256263 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.256482 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.256568 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.256785 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.256873 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.257100 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.257188 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.257449 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.257557 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.257708 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.257800 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.258020 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.258111 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.258332 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.258422 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.258641 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.258751 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.258975 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.259063 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.259278 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.259377 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.259582 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.259672 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.259883 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.259969 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.260187 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.260284 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.260490 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.260577 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.260796 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.260882 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.261093 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.261188 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.261394 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.261481 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.261692 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.261786 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.262009 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.262108 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.262342 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.262434 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.262650 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.262782 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.262981 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.263069 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.263282 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.263374 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.263585 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.263678 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.263894 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.263981 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.264200 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.264295 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.264507 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.264593 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.264811 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.264904 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.265134 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.265220 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.265459 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.265546 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.265775 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.265862 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.266086 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.266172 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.266394 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.266489 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.266727 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.266863 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:31:54.267045 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.267135 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.267356 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.267451 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.267666 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.267760 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.267982 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.268069 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.268297 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.268394 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.268623 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.268710 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.268941 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.269030 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.269256 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.269343 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.269571 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.269665 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.269881 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.269996 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.270197 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.270293 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.270520 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.270606 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.270868 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.270958 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.271182 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.271280 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.271522 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.271611 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.271857 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.271942 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.272165 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.272253 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.272486 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.272573 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.272801 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.272889 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.273112 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.273200 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.273420 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.273513 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.273726 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.273814 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.274053 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.274142 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.274366 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.274451 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.274676 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.274795 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.275017 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.275105 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.275329 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.275416 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.275641 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.275737 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.275952 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.276040 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.276263 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.276358 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.276575 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.276671 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.276897 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.276982 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.277211 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.277303 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.277527 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.277623 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.277839 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.278423 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.278720 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.278827 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.279014 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.279114 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.279328 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.279421 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.279642 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.279736 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.279952 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.280040 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.280259 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.280354 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.280566 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.280652 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.280877 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.280973 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.281180 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.281267 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.281501 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.281589 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.281824 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.281918 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.282133 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.282219 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.282446 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.282531 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.282783 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.282874 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.283095 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.283182 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.283403 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.283498 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.283712 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.283797 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.284016 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.284109 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.284323 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.284424 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.284639 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.284725 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.284945 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.285031 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.285268 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.285362 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.285576 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.285662 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.285880 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.286007 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.286203 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.286365 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.286509 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.286597 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.286843 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.286934 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.287161 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.287287 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.287472 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.287568 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.287783 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.287878 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.288094 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.288182 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.288407 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.288500 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.288727 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.288812 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.289035 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.289135 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.289347 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.289434 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.289665 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.289759 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.289977 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.290064 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.290285 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.290371 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.290599 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.290755 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.290939 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.291040 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.291252 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.291346 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.291558 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.291655 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.291867 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.291962 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.292170 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.292257 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.292475 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.292575 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.292779 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.292867 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.293088 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.293187 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.293390 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.293495 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.294263 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.294362 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.294576 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.294715 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.294913 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.295045 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.295286 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.295386 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.295614 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.295710 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.295926 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.296015 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.296231 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.296317 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.296536 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.296630 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.296841 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.296937 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.297147 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.297234 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.297459 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.297545 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.297770 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.297859 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.298081 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.298175 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.298392 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.298487 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.298743 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.298835 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.299058 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.299154 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.299371 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.299474 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.299678 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.299774 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.299983 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.300070 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.300291 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.300385 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.300603 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.300690 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.300923 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.301011 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.301235 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.301330 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.301554 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.301642 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.301865 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.301953 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.302189 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.302289 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.302499 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.302586 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.302839 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.302927 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.303142 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.303231 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.303457 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.303558 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.303776 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.303871 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.304098 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.304187 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.304411 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.304505 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.304728 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.304815 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.305039 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.305127 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.305352 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.305496 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.305663 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.305751 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.305974 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.306063 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.306285 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.306373 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.306597 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.306716 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.306942 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.307030 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.307251 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.307341 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.307569 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.307673 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.307878 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.307966 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.308200 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.308286 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.308506 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.308605 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.308819 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.308912 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.309120 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.309212 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.309459 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.309559 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.309772 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.309858 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.310096 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.310182 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.310403 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.310500 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.310729 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.310821 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.311050 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.311136 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.311357 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.311445 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.311666 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.311755 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.311976 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.312071 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.312280 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.312380 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.312581 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.312673 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.312889 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.312977 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.313205 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.313293 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.313512 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.313607 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.313819 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.313906 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.314122 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.314218 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.314433 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.314527 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.314771 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.314899 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.315080 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.315177 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.315383 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.315473 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.315689 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.315964 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.316424 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.316513 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.316594 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.316672 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.316749 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.316842 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.316923 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.317008 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.317189 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.317277 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.317495 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.317600 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.317812 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.317901 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.318121 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.318222 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.318423 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.318512 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.318746 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.318854 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.319056 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.319145 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.319401 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.319493 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.319711 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.319805 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.320014 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.320101 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.320330 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.320419 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.320635 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.320720 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.320941 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.321026 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.321256 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.321353 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.321565 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.321666 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.321873 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.321970 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.322183 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.322269 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.322493 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.322578 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.322829 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.322936 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.323140 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.323267 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.323451 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.323539 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.323760 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.323857 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.324068 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.324162 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.324384 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.324471 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.324697 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.324793 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.325032 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.325119 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.325342 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.325429 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.325646 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.325741 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.325954 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.326048 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.326265 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.326359 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.326585 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.326846 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.326949 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.327181 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.327269 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.327497 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.327594 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.328072 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.328173 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.328392 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.328480 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.328705 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.328801 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.329017 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.329105 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.329339 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.329427 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.329662 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.329758 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.329965 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.330228 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.330317 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.330564 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.330651 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.330891 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.330997 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.331204 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.331292 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.331511 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.331599 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.331816 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.331906 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.332120 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.332207 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.332429 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.332515 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.332733 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.332822 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.333039 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.333165 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.333343 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.333485 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.333645 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.333799 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.333958 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.334110 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.334262 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.334426 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.334579 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.334764 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.334909 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.335077 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.335231 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.335386 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.335540 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.335702 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.335844 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.336012 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.336146 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.336321 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.336449 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.336630 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.336793 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.336939 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.337098 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.337257 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.337435 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.337572 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.337764 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.337909 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.338105 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.338196 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.338410 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.338499 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.338729 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.338818 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.339057 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.339145 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.339361 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.339453 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.339664 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.339753 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.339968 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.340128 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.340277 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.340366 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.341120 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.341209 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.341424 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.341521 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.341734 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.341821 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.342041 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.342127 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.342350 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.342446 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.342659 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.342780 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.342983 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.343083 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.343292 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.343390 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.343598 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.343685 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.343912 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.343997 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.344217 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.344311 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.344519 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.344605 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.344817 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.344903 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.345131 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.345219 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.345436 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.345523 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.345739 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.345826 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.346040 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.346127 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.346337 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.346423 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.346644 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.346782 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.346971 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.347059 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.347274 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.347362 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.347576 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.347672 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.347878 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.347963 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.348183 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.348269 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.348485 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.348582 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.348806 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.348893 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.349114 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.349201 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.349415 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.349511 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.349719 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.349806 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.350028 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.350115 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.350330 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.350425 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.350633 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.350749 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.350968 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.351067 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.351277 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.351365 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.351584 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.351672 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.351882 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.351968 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.352191 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.352280 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.352494 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.352588 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.352797 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.352884 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.353096 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.353184 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.353403 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.353489 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.353701 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.353788 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.354002 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.354091 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.354302 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.354389 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.354603 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.354752 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.354929 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.355025 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.355239 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.355325 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.355545 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.355640 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.355849 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.355935 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.356712 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.357029 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.357443 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.357760 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.358071 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.358381 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.358475 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.358718 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.358808 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.359044 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.359136 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.359360 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.359448 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.359670 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.359765 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.359988 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.360075 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.360296 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.360383 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.360645 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.360741 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.360953 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.361041 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.361309 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.361396 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.361615 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.361710 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.361928 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.362015 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.362250 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.362336 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.362562 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.362657 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.362900 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.362998 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.363208 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.363295 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.363514 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.363602 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.363836 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.363924 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.364148 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.364243 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.364462 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.364550 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.364771 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.364858 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.365081 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.365175 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.365403 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.365491 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.365710 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.365805 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.366020 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.366107 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.366328 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.366417 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.366639 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.366746 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.366975 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.367062 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.367291 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.367386 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.367600 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.367687 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.367911 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.368005 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.368219 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.368317 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.368528 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.368614 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.368834 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.368930 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.369142 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.369234 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.369454 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.369539 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.369759 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.369860 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.370064 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.370151 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.370376 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.370462 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.370683 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.370902 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.370997 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.371085 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.371306 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.371394 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.371612 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.371722 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.371947 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.372048 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.372254 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.372349 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.372655 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.372752 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.372970 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.373056 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.373279 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.373373 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.373586 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.373675 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.373891 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.373977 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.374198 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.374325 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.374512 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.374641 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.374863 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.374963 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.375170 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.375270 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.375574 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.375660 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.375885 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.375979 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.376198 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.376298 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.376509 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.376597 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.376813 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.376948 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.377114 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.377236 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.377427 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.377554 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.377749 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.377870 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.378053 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.378184 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.378356 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.378492 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.378658 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.378822 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.379001 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.379137 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.379306 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.379464 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.379626 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.379773 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.380040 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.380136 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.380350 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.380446 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.380656 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.380751 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.380979 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.381073 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.381302 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.381396 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.381657 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.381743 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.381977 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.382065 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.382297 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.382391 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.382619 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.382742 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.382948 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.383036 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.383259 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.383353 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.383566 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.383663 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.383889 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.383991 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.384211 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.384301 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.384519 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.384619 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.384830 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.384928 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.385133 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.385228 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.385453 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.385543 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.385774 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.385871 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.386084 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.386171 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.386400 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.386487 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.386718 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.386820 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.387051 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.387140 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.387406 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.387505 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.387728 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.387824 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.388056 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.388143 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.388386 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.388479 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.388693 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.388785 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.389006 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.389094 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.389311 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.389398 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.389616 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.389726 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.389938 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.390026 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.390244 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.390340 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.390555 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.390643 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.390890 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.390980 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.391200 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.391305 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.391502 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.391591 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.391810 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.391897 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.392131 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.392227 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.392438 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.392526 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.392759 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.392966 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.393069 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.393163 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.393363 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.393451 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.394372 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.394472 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.394555 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.394646 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.394790 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.394889 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.394972 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.395051 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.395139 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.395221 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.395300 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.395378 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.395562 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.395651 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.395887 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.395976 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.396196 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.396283 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.396516 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.396604 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.396849 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.396940 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.397184 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.397271 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.397495 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.397585 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.397829 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.397919 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.398156 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.398245 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.398475 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.398571 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.398815 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.398963 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.399144 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.399301 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.399450 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.399646 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.399744 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.399987 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.400083 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.400314 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.400403 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.400636 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.400790 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.400932 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.401074 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.401214 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.401516 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.401607 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.401818 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.401907 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.402121 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.402209 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.402443 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.402533 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.402767 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.402859 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.403631 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.403778 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.403942 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.404040 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.404248 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.404336 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.404555 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.404650 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.404857 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.404947 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.405188 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.405278 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.405487 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.405583 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.405815 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.405902 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.406120 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.406206 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.406427 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.406523 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.406763 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.406854 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.407075 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.407161 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.407386 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.407486 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.407703 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.407793 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.408016 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.408110 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.408331 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.408428 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.408645 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.408733 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.408952 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.409039 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.409265 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.409364 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.409578 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.409666 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.409894 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.409980 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.410215 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.410436 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.410525 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.410794 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.410948 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.411112 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.411251 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.411426 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.411572 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.411739 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.411893 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.412052 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.412215 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.412364 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.412675 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.412763 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.412986 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.413089 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.413295 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.413383 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.413606 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.413694 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.413931 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.414031 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.414251 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.414339 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.414577 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.414673 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.414921 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.415026 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.415240 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.415328 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.415552 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.415638 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.415860 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.415949 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.416172 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.416260 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.416501 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.416587 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.416831 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.416921 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.417134 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.417220 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.417447 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.417548 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.417770 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.417859 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.418083 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.418171 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.418394 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.418601 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.419330 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.419522 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.419651 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.419852 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.419965 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.420169 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.420265 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.420498 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.420586 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.420822 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.420919 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.421145 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.421240 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.421463 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.421551 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.421780 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.421881 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.422099 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.422195 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.422414 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.422503 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.422745 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.422857 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.423064 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.423152 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.423379 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.423584 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.423702 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.423903 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.424035 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.424239 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.424382 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.424569 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.424709 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.424896 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.425030 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.425217 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.425349 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.425538 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.425674 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.425867 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.426176 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.426263 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.426483 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.426647 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.426827 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.426917 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.427137 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.427237 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.427443 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.427567 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.427770 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.427892 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.428082 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.428217 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.428387 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.428554 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.428708 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.428867 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.429017 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.429180 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.429495 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.429592 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.429812 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.429898 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.430122 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.430209 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.430457 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.430546 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.430795 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.430887 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.431109 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.431196 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.431419 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.431515 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.431733 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.431819 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.432037 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.432270 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.432368 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.432625 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.432715 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.432937 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.433024 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.433244 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.433340 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.433549 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.433637 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.433857 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.433945 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.434192 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.434284 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.434510 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.434610 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.434848 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.434938 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.435154 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.435245 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.435473 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.435575 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.435775 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.435863 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.436080 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.436170 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.436385 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.436472 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.436695 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.436782 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.437002 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.437098 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.437307 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.437395 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.437613 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.437715 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.437920 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.438014 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.438229 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.438317 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.438533 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.438630 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.438869 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.438959 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.439171 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.439258 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.439482 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.439591 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.439786 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.439882 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.440091 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.440185 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.440390 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.440486 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.440702 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.440789 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.441005 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.441099 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.441313 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.441401 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.441628 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.441723 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.441939 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.442027 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.442255 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.442343 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.442561 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.442648 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.442901 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.443041 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.443249 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.443339 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.443566 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.443654 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.443963 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.444096 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.444332 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.444421 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.444654 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.444741 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.444969 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.445066 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.445300 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.445389 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.445618 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.445706 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.445933 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.446031 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.446247 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.446333 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.446571 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.446659 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.446915 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.447143 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.447233 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.447487 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.447583 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.447813 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.447900 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.448118 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.448206 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.448428 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.448516 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.448742 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.448843 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.449051 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.449140 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.449362 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.449457 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.449673 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.450279 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.450507 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.450596 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.450845 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.450938 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.451157 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.451259 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.451467 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.451555 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.451778 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.451873 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.452097 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.452194 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.452416 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.452504 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.452731 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.453069 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.453298 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.453387 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.453612 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.453707 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.453924 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.454022 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.454235 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.454323 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.454542 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.454628 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.454877 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.454982 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.455193 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.455280 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.455525 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.455615 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.455842 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.455943 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.456148 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.456237 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.456471 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.456558 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.456795 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.456956 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.457112 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.457200 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.457429 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.457516 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.457745 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.457840 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.458079 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.458172 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.458409 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.458511 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.458740 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.458843 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.459065 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.459171 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.459377 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.459464 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.459707 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.459796 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.460044 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.460135 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.460373 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.460462 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.460699 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.460790 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.461005 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.461102 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.461311 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.461408 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.461616 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.461704 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.461925 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.462014 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.462242 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.462340 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.462552 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.462649 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.462885 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.462975 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.463191 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.463296 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.463501 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.463590 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.463805 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.463893 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.464108 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.464198 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.464411 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.464500 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.464714 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.464804 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.465023 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.465112 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.465324 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.465433 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.466224 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.466322 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.466536 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.466625 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.466871 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.466961 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.467173 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.467272 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.467478 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.467568 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.467785 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.467873 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.468086 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.468186 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.468392 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.468529 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.468692 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.468780 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.468995 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.469091 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.469296 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.469385 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.469600 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.469691 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.469911 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.470007 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.470220 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.470310 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.470528 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.470616 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.470868 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.470960 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.471179 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.471269 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.471484 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.471570 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.471787 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.471875 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.472095 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.472182 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.472402 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.472497 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.472707 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.472795 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.473038 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.473127 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.473350 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.473446 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.473659 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.473749 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.473971 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.474066 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.474281 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.474383 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.474591 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.474679 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.474927 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.475016 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.475255 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.475355 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.475581 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.475670 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.475888 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.475976 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.476214 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.476312 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.476532 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.476628 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.476846 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.476934 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.477158 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.477254 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.477469 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.477556 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.477785 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.477873 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.478090 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.478185 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.478406 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.478495 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.478739 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.478832 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.479053 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.479144 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.479361 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.479449 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.479675 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.479763 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.479983 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.480073 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.480291 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.480380 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.480604 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.480704 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.480915 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.481002 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.481267 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.481356 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.481578 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.481674 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.481887 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.481973 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.482198 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.482285 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.482514 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.482615 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.482857 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.482988 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.483176 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.483266 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.483491 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.483588 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.483812 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.483902 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.484122 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.484208 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.484432 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.484521 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.484736 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.484832 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.484981 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 07:31:54.485076 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.485384 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.485715 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.486068 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.486389 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.486758 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.487095 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.487417 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.487736 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.488047 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:31:54.488297 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 07:31:54.638172 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: INFO dbcounter [None req-56ebbbf6-463f-4150-b5d7-85b2c6de2a6a None None] Registered counter for database nova_api Aug 24 07:31:54.642382 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: INFO dbcounter [None req-f168c1ae-99ce-497f-88f4-24980b1bc093 None None] Registered counter for database nova_api Aug 24 07:31:54.659923 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG oslo_db.sqlalchemy.engines [None req-56ebbbf6-463f-4150-b5d7-85b2c6de2a6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112129) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:31:54.662331 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG oslo_db.sqlalchemy.engines [None req-f168c1ae-99ce-497f-88f4-24980b1bc093 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112128) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:31:54.666586 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG dbcounter [-] [112129] Writer thread running {{(pid=112129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:31:54.668795 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG dbcounter [-] [112128] Writer thread running {{(pid=112128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:31:54.722331 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.context [None req-56ebbbf6-463f-4150-b5d7-85b2c6de2a6a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),25bce80b-e624-439b-a839-ab618d931874(cell1) {{(pid=112129) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 07:31:54.724909 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.context [None req-f168c1ae-99ce-497f-88f4-24980b1bc093 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),25bce80b-e624-439b-a839-ab618d931874(cell1) {{(pid=112128) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 07:31:54.726279 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG oslo_concurrency.lockutils [None req-56ebbbf6-463f-4150-b5d7-85b2c6de2a6a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:31:54.726857 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG oslo_concurrency.lockutils [None req-56ebbbf6-463f-4150-b5d7-85b2c6de2a6a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:31:54.728506 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG oslo_concurrency.lockutils [None req-56ebbbf6-463f-4150-b5d7-85b2c6de2a6a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:31:54.728723 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG oslo_concurrency.lockutils [None req-f168c1ae-99ce-497f-88f4-24980b1bc093 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:31:54.729201 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG oslo_concurrency.lockutils [None req-f168c1ae-99ce-497f-88f4-24980b1bc093 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:31:54.729416 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG oslo_concurrency.lockutils [None req-56ebbbf6-463f-4150-b5d7-85b2c6de2a6a None None] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:31:54.729926 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG oslo_concurrency.lockutils [None req-56ebbbf6-463f-4150-b5d7-85b2c6de2a6a None None] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:31:54.730811 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG oslo_concurrency.lockutils [None req-f168c1ae-99ce-497f-88f4-24980b1bc093 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:31:54.731578 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG oslo_concurrency.lockutils [None req-f168c1ae-99ce-497f-88f4-24980b1bc093 None None] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:31:54.732026 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG oslo_concurrency.lockutils [None req-f168c1ae-99ce-497f-88f4-24980b1bc093 None None] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:31:54.732245 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG oslo_concurrency.lockutils [None req-56ebbbf6-463f-4150-b5d7-85b2c6de2a6a None None] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:31:54.733997 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG oslo_concurrency.lockutils [None req-f168c1ae-99ce-497f-88f4-24980b1bc093 None None] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:31:54.734320 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: INFO dbcounter [None req-56ebbbf6-463f-4150-b5d7-85b2c6de2a6a None None] Registered counter for database nova_cell0 Aug 24 07:31:54.736002 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: INFO dbcounter [None req-f168c1ae-99ce-497f-88f4-24980b1bc093 None None] Registered counter for database nova_cell0 Aug 24 07:31:54.739784 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: INFO dbcounter [None req-56ebbbf6-463f-4150-b5d7-85b2c6de2a6a None None] Registered counter for database nova_cell1 Aug 24 07:31:54.741402 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: INFO dbcounter [None req-f168c1ae-99ce-497f-88f4-24980b1bc093 None None] Registered counter for database nova_cell1 Aug 24 07:31:54.746861 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG oslo_db.sqlalchemy.engines [None req-56ebbbf6-463f-4150-b5d7-85b2c6de2a6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112129) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:31:54.748542 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG oslo_db.sqlalchemy.engines [None req-56ebbbf6-463f-4150-b5d7-85b2c6de2a6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112129) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:31:54.749957 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG oslo_db.sqlalchemy.engines [None req-f168c1ae-99ce-497f-88f4-24980b1bc093 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112128) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:31:54.754442 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG dbcounter [-] [112128] Writer thread running {{(pid=112128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:31:54.754562 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG dbcounter [-] [112129] Writer thread running {{(pid=112129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:31:54.755234 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG oslo_db.sqlalchemy.engines [None req-f168c1ae-99ce-497f-88f4-24980b1bc093 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112128) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:31:54.756809 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG dbcounter [-] [112129] Writer thread running {{(pid=112129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:31:54.896004 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG dbcounter [-] [112128] Writer thread running {{(pid=112128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:31:54.897982 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: INFO dbcounter [None req-56ebbbf6-463f-4150-b5d7-85b2c6de2a6a None None] Registered counter for database nova_cell0 Aug 24 07:31:54.904626 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG oslo_db.sqlalchemy.engines [None req-56ebbbf6-463f-4150-b5d7-85b2c6de2a6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112129) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:31:54.904854 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: INFO dbcounter [None req-f168c1ae-99ce-497f-88f4-24980b1bc093 None None] Registered counter for database nova_cell0 Aug 24 07:31:54.908932 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG dbcounter [-] [112129] Writer thread running {{(pid=112129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:31:54.913668 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG oslo_db.sqlalchemy.engines [None req-f168c1ae-99ce-497f-88f4-24980b1bc093 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112128) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:31:54.917946 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG dbcounter [-] [112128] Writer thread running {{(pid=112128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:31:55.251076 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: WARNING keystonemiddleware.auth_token [None req-56ebbbf6-463f-4150-b5d7-85b2c6de2a6a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 07:31:55.255640 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: WARNING keystonemiddleware.auth_token [None req-f168c1ae-99ce-497f-88f4-24980b1bc093 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 07:31:55.258418 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: WARNING keystonemiddleware.auth_token [None req-56ebbbf6-463f-4150-b5d7-85b2c6de2a6a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 07:31:55.262988 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: WARNING keystonemiddleware.auth_token [None req-f168c1ae-99ce-497f-88f4-24980b1bc093 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 07:31:55.603734 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: WARNING keystonemiddleware.auth_token [None req-56ebbbf6-463f-4150-b5d7-85b2c6de2a6a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 07:31:55.610295 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: WARNING keystonemiddleware.auth_token [None req-56ebbbf6-463f-4150-b5d7-85b2c6de2a6a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 07:31:55.610731 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: WARNING keystonemiddleware.auth_token [None req-f168c1ae-99ce-497f-88f4-24980b1bc093 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 07:31:55.615663 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c89af079c0 pid: 112129 (default app) Aug 24 07:31:55.616680 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: WARNING keystonemiddleware.auth_token [None req-f168c1ae-99ce-497f-88f4-24980b1bc093 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 07:31:55.617744 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi [None req-56ebbbf6-463f-4150-b5d7-85b2c6de2a6a None None] Calling method '>' {{(pid=112129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:31:55.618953 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: INFO nova.api.openstack.requestlog [None req-56ebbbf6-463f-4150-b5d7-85b2c6de2a6a None None] 10.222.0.42 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001762 Aug 24 07:31:55.619356 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: [pid: 112129|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 788 bytes} [Wed Aug 24 07:31:55 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:31:55.622075 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c89af079c0 pid: 112128 (default app) Aug 24 07:33:13.236158 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi [None req-56ebbbf6-463f-4150-b5d7-85b2c6de2a6a None None] Calling method '>' {{(pid=112129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:33:13.237683 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: INFO nova.api.openstack.requestlog [None req-56ebbbf6-463f-4150-b5d7-85b2c6de2a6a None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Aug 24 07:33:13.238269 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: [pid: 112129|app: 0|req: 2/2] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 24 07:33:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:33:13.250541 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG dbcounter [-] [112128] Writing DB stats nova_api:SELECT=3 {{(pid=112128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:33:13.251809 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG dbcounter [-] [112128] Writing DB stats nova_cell0:SELECT=3 {{(pid=112128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:33:13.253579 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG dbcounter [-] [112128] Writing DB stats nova_cell1:SELECT=3 {{(pid=112128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:33:13.255061 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG dbcounter [-] [112128] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:33:14.132829 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi [None req-b9933c63-2a8f-46bd-9509-cb8b34b1756b admin admin] Calling method '>' {{(pid=112128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:33:14.171123 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: INFO nova.api.openstack.requestlog [None req-b9933c63-2a8f-46bd-9509-cb8b34b1756b admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.925870 Aug 24 07:33:14.172060 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: [pid: 112128|app: 0|req: 1/3] 10.222.0.42 () {60 vars in 1292 bytes} [Wed Aug 24 07:33:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:33:16.527430 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi [None req-56ebbbf6-463f-4150-b5d7-85b2c6de2a6a None None] Calling method '>' {{(pid=112129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:33:16.528252 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: INFO nova.api.openstack.requestlog [None req-56ebbbf6-463f-4150-b5d7-85b2c6de2a6a None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001555 Aug 24 07:33:16.533783 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: [pid: 112129|app: 0|req: 3/4] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 24 07:33:16 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:33:16.984851 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi [None req-2d974c37-33d9-4f81-9929-adc3849e7fe5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "c1", "rxtx_factor": 1.0, "vcpus": 1, "disk": 1, "name": "cirros256"}} {{(pid=112128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:33:17.006227 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:33:17.006227 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: warnings.warn(msg) Aug 24 07:33:17.040397 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: INFO nova.api.openstack.requestlog [None req-2d974c37-33d9-4f81-9929-adc3849e7fe5 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.505525 Aug 24 07:33:17.041532 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: [pid: 112128|app: 0|req: 2/5] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Aug 24 07:33:16 2022] POST /compute/v2.1/flavors => generated 407 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 07:33:17.056659 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG dbcounter [-] [112129] Writing DB stats nova_api:SELECT=3 {{(pid=112129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:33:17.057633 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG dbcounter [-] [112129] Writing DB stats nova_cell0:SELECT=3 {{(pid=112129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:33:17.058545 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG dbcounter [-] [112129] Writing DB stats nova_cell1:SELECT=3 {{(pid=112129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:33:17.059672 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG dbcounter [-] [112129] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:33:17.271889 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi [None req-7438b083-086a-49b4-a853-eb0bfe4d6d7f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:33:17.276265 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:33:17.276265 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: warnings.warn(msg) Aug 24 07:33:17.338292 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: INFO nova.api.openstack.requestlog [None req-7438b083-086a-49b4-a853-eb0bfe4d6d7f admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.288514 Aug 24 07:33:17.338921 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: [pid: 112129|app: 0|req: 4/6] 10.222.0.42 () {64 vars in 1336 bytes} [Wed Aug 24 07:33:17 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:33:19.704505 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi [None req-2d974c37-33d9-4f81-9929-adc3849e7fe5 admin admin] Calling method '>' {{(pid=112128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:33:19.705546 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: INFO nova.api.openstack.requestlog [None req-2d974c37-33d9-4f81-9929-adc3849e7fe5 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Aug 24 07:33:19.705941 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: [pid: 112128|app: 0|req: 3/7] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 24 07:33:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:33:20.351064 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi [None req-abe893ae-22ee-41ef-bda5-ef7d2d3080aa admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 512, "os-flavor-access:is_public": true, "name": "ds512M", "swap": 0, "id": "d1"}} {{(pid=112129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:33:20.371472 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:33:20.371472 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: warnings.warn(msg) Aug 24 07:33:20.393586 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: INFO nova.api.openstack.requestlog [None req-abe893ae-22ee-41ef-bda5-ef7d2d3080aa admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.681120 Aug 24 07:33:20.394737 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: [pid: 112129|app: 0|req: 5/8] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Aug 24 07:33:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 07:33:20.406595 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi [None req-88ad7970-75e2-4313-a6cf-80fba15f6e6b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:33:20.409965 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:33:20.409965 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: warnings.warn(msg) Aug 24 07:33:20.443726 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: INFO nova.api.openstack.requestlog [None req-88ad7970-75e2-4313-a6cf-80fba15f6e6b admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041131 Aug 24 07:33:20.445229 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: [pid: 112128|app: 0|req: 4/9] 10.222.0.42 () {64 vars in 1336 bytes} [Wed Aug 24 07:33:20 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:33:22.829822 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi [None req-abe893ae-22ee-41ef-bda5-ef7d2d3080aa admin admin] Calling method '>' {{(pid=112129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:33:22.830859 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: INFO nova.api.openstack.requestlog [None req-abe893ae-22ee-41ef-bda5-ef7d2d3080aa admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Aug 24 07:33:22.831256 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: [pid: 112129|app: 0|req: 6/10] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 24 07:33:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:33:23.234943 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi [None req-d969bd60-e816-488e-abd4-b75a25299216 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d2", "vcpus": 1, "disk": 10, "name": "ds1G", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024}} {{(pid=112128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:33:23.255176 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: INFO nova.api.openstack.requestlog [None req-d969bd60-e816-488e-abd4-b75a25299216 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.417350 Aug 24 07:33:23.255721 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: [pid: 112128|app: 0|req: 5/11] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Aug 24 07:33:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 07:33:23.267568 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi [None req-8489bb83-0012-4e8f-a7e7-a419dadbe91e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:33:23.290955 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: INFO nova.api.openstack.requestlog [None req-8489bb83-0012-4e8f-a7e7-a419dadbe91e admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027083 Aug 24 07:33:23.291515 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: [pid: 112129|app: 0|req: 7/12] 10.222.0.42 () {64 vars in 1336 bytes} [Wed Aug 24 07:33:23 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:33:25.742729 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi [None req-d969bd60-e816-488e-abd4-b75a25299216 admin admin] Calling method '>' {{(pid=112128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:33:25.743714 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: INFO nova.api.openstack.requestlog [None req-d969bd60-e816-488e-abd4-b75a25299216 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Aug 24 07:33:25.744164 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: [pid: 112128|app: 0|req: 6/13] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 24 07:33:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:33:26.187704 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi [None req-1f050c80-8048-480e-93d4-54a3defd73a1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "id": "d3", "rxtx_factor": 1.0, "swap": 0, "vcpus": 2, "disk": 10, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=112129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:33:26.208683 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: INFO nova.api.openstack.requestlog [None req-1f050c80-8048-480e-93d4-54a3defd73a1 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.458360 Aug 24 07:33:26.209523 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: [pid: 112129|app: 0|req: 8/14] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Aug 24 07:33:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 07:33:26.223136 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi [None req-1168ee20-06bf-42e4-ad6b-b2bda56c6f15 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:33:26.248907 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: INFO nova.api.openstack.requestlog [None req-1168ee20-06bf-42e4-ad6b-b2bda56c6f15 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031178 Aug 24 07:33:26.249743 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: [pid: 112128|app: 0|req: 7/15] 10.222.0.42 () {64 vars in 1336 bytes} [Wed Aug 24 07:33:26 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:33:28.599516 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi [None req-1f050c80-8048-480e-93d4-54a3defd73a1 admin admin] Calling method '>' {{(pid=112129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:33:28.601047 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: INFO nova.api.openstack.requestlog [None req-1f050c80-8048-480e-93d4-54a3defd73a1 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001972 Aug 24 07:33:28.601675 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: [pid: 112129|app: 0|req: 9/16] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 24 07:33:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:33:29.053149 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi [None req-dbc83da6-ab22-4f36-9f7c-88d5eac9bd3e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "id": "d4", "rxtx_factor": 1.0, "vcpus": 4, "swap": 0, "name": "ds4G", "disk": 20, "os-flavor-access:is_public": true}} {{(pid=112128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:33:29.074638 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: INFO nova.api.openstack.requestlog [None req-dbc83da6-ab22-4f36-9f7c-88d5eac9bd3e admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.466443 Aug 24 07:33:29.075356 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: [pid: 112128|app: 0|req: 8/17] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Aug 24 07:33:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 07:33:29.087767 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi [None req-c4040b2f-cf27-4fcf-85c0-61c4255ce834 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:33:29.112344 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: INFO nova.api.openstack.requestlog [None req-c4040b2f-cf27-4fcf-85c0-61c4255ce834 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028496 Aug 24 07:33:29.113036 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: [pid: 112129|app: 0|req: 10/18] 10.222.0.42 () {64 vars in 1336 bytes} [Wed Aug 24 07:33:29 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:33:31.820643 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi [None req-dbc83da6-ab22-4f36-9f7c-88d5eac9bd3e admin admin] Calling method '>' {{(pid=112128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:33:31.821586 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: INFO nova.api.openstack.requestlog [None req-dbc83da6-ab22-4f36-9f7c-88d5eac9bd3e admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Aug 24 07:33:31.822007 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: [pid: 112128|app: 0|req: 9/19] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 24 07:33:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:33:32.248936 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi [None req-894c1912-dc76-45b9-bc45-b327ab71a0ff admin admin] Calling method '>' {{(pid=112129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:33:32.276342 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: INFO nova.api.openstack.requestlog [None req-894c1912-dc76-45b9-bc45-b327ab71a0ff admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.448235 Aug 24 07:33:32.276930 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: [pid: 112129|app: 0|req: 11/20] 10.222.0.42 () {60 vars in 1292 bytes} [Wed Aug 24 07:33:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:33:34.767691 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi [None req-dbc83da6-ab22-4f36-9f7c-88d5eac9bd3e admin admin] Calling method '>' {{(pid=112128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:33:34.768759 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: INFO nova.api.openstack.requestlog [None req-dbc83da6-ab22-4f36-9f7c-88d5eac9bd3e admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Aug 24 07:33:34.769175 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: [pid: 112128|app: 0|req: 10/21] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 24 07:33:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:33:35.201997 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi [None req-4eef5ee7-ce0a-41d9-858c-2a1c7146f795 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "rxtx_factor": 1.0, "name": "m1.tiny", "swap": 0, "disk": 1}} {{(pid=112129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:33:35.220878 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: INFO nova.api.openstack.requestlog [None req-4eef5ee7-ce0a-41d9-858c-2a1c7146f795 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.444918 Aug 24 07:33:35.221440 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: [pid: 112129|app: 0|req: 12/22] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Aug 24 07:33:34 2022] POST /compute/v2.1/flavors => generated 402 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 07:33:35.237798 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi [None req-5bdd8f09-5bff-4e34-b4a0-7e295aabf046 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:33:35.266614 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: INFO nova.api.openstack.requestlog [None req-5bdd8f09-5bff-4e34-b4a0-7e295aabf046 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034116 Aug 24 07:33:35.267232 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: [pid: 112128|app: 0|req: 11/23] 10.222.0.42 () {64 vars in 1333 bytes} [Wed Aug 24 07:33:35 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:33:37.593582 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi [None req-4eef5ee7-ce0a-41d9-858c-2a1c7146f795 admin admin] Calling method '>' {{(pid=112129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:33:37.594630 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: INFO nova.api.openstack.requestlog [None req-4eef5ee7-ce0a-41d9-858c-2a1c7146f795 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Aug 24 07:33:37.595071 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: [pid: 112129|app: 0|req: 13/24] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 24 07:33:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:33:37.997091 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi [None req-8d6b3c02-21e7-4ef9-808f-883fd6b3fead admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 20, "rxtx_factor": 1.0, "ram": 2048, "swap": 0, "vcpus": 1, "name": "m1.small"}} {{(pid=112128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:33:38.015754 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: INFO nova.api.openstack.requestlog [None req-8d6b3c02-21e7-4ef9-808f-883fd6b3fead admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.414131 Aug 24 07:33:38.016301 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: [pid: 112128|app: 0|req: 12/25] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Aug 24 07:33:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 07:33:38.028094 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi [None req-aaedb00d-185f-49e4-a5a0-fcc45d10f906 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:33:38.051400 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: INFO nova.api.openstack.requestlog [None req-aaedb00d-185f-49e4-a5a0-fcc45d10f906 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027035 Aug 24 07:33:38.052488 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: [pid: 112129|app: 0|req: 14/26] 10.222.0.42 () {64 vars in 1333 bytes} [Wed Aug 24 07:33:38 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:33:40.402262 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi [None req-8d6b3c02-21e7-4ef9-808f-883fd6b3fead admin admin] Calling method '>' {{(pid=112128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:33:40.403301 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: INFO nova.api.openstack.requestlog [None req-8d6b3c02-21e7-4ef9-808f-883fd6b3fead admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Aug 24 07:33:40.403948 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: [pid: 112128|app: 0|req: 13/27] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 24 07:33:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:33:40.825991 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi [None req-cea70dd8-d4e2-4df2-991b-fa2654a858d5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "swap": 0, "id": "3", "ram": 4096, "os-flavor-access:is_public": true, "vcpus": 2, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40}} {{(pid=112129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:33:40.848738 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: INFO nova.api.openstack.requestlog [None req-cea70dd8-d4e2-4df2-991b-fa2654a858d5 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.438235 Aug 24 07:33:40.849307 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: [pid: 112129|app: 0|req: 15/28] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Aug 24 07:33:40 2022] POST /compute/v2.1/flavors => generated 406 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 07:33:40.862996 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi [None req-6ec5f719-42f0-4946-adf5-70c33feede4d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:33:40.889517 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: INFO nova.api.openstack.requestlog [None req-6ec5f719-42f0-4946-adf5-70c33feede4d admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030241 Aug 24 07:33:40.890125 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: [pid: 112128|app: 0|req: 14/29] 10.222.0.42 () {64 vars in 1333 bytes} [Wed Aug 24 07:33:40 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:33:43.314134 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi [None req-cea70dd8-d4e2-4df2-991b-fa2654a858d5 admin admin] Calling method '>' {{(pid=112129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:33:43.315092 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: INFO nova.api.openstack.requestlog [None req-cea70dd8-d4e2-4df2-991b-fa2654a858d5 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Aug 24 07:33:43.315775 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: [pid: 112129|app: 0|req: 16/30] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 24 07:33:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:33:43.753860 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi [None req-004c0764-3704-4907-9482-48c0598119da admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "ram": 8192, "rxtx_factor": 1.0, "swap": 0, "name": "m1.large", "os-flavor-access:is_public": true, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4}} {{(pid=112128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:33:43.761538 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG dbcounter [-] [112128] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=112128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:33:43.793068 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: INFO nova.api.openstack.requestlog [None req-004c0764-3704-4907-9482-48c0598119da admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.470679 Aug 24 07:33:43.800815 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: [pid: 112128|app: 0|req: 15/31] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Aug 24 07:33:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 07:33:43.806121 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi [None req-888db9b2-fad3-46df-9787-ce26daf35309 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:33:43.841374 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: INFO nova.api.openstack.requestlog [None req-888db9b2-fad3-46df-9787-ce26daf35309 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038892 Aug 24 07:33:43.841865 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: [pid: 112129|app: 0|req: 17/32] 10.222.0.42 () {64 vars in 1333 bytes} [Wed Aug 24 07:33:43 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:33:46.239162 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi [None req-004c0764-3704-4907-9482-48c0598119da admin admin] Calling method '>' {{(pid=112128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:33:46.240142 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: INFO nova.api.openstack.requestlog [None req-004c0764-3704-4907-9482-48c0598119da admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 Aug 24 07:33:46.241102 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: [pid: 112128|app: 0|req: 16/33] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 24 07:33:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:33:46.689005 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi [None req-3b267863-bd7a-4fe4-a4f5-efdf5451da16 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 16384, "disk": 160, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "name": "m1.xlarge", "vcpus": 8, "os-flavor-access:is_public": true}} {{(pid=112129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:33:46.710020 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: INFO nova.api.openstack.requestlog [None req-3b267863-bd7a-4fe4-a4f5-efdf5451da16 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.462481 Aug 24 07:33:46.710577 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: [pid: 112129|app: 0|req: 18/34] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Aug 24 07:33:46 2022] POST /compute/v2.1/flavors => generated 408 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 07:33:46.722926 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi [None req-32b1d7b5-1959-4455-900e-27aa252b9ae2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:33:46.752436 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: INFO nova.api.openstack.requestlog [None req-32b1d7b5-1959-4455-900e-27aa252b9ae2 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033289 Aug 24 07:33:46.753011 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: [pid: 112128|app: 0|req: 17/35] 10.222.0.42 () {64 vars in 1333 bytes} [Wed Aug 24 07:33:46 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:34:05.371619 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi [None req-3b267863-bd7a-4fe4-a4f5-efdf5451da16 admin admin] Calling method '>' {{(pid=112129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:34:05.372627 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: INFO nova.api.openstack.requestlog [None req-3b267863-bd7a-4fe4-a4f5-efdf5451da16 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Aug 24 07:34:05.373028 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: [pid: 112129|app: 0|req: 19/36] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 24 07:34:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:34:05.384071 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG dbcounter [-] [112128] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=112128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:34:05.762640 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi [None req-49a00128-8467-4281-9cc4-e0e32052c4c3 admin admin] Calling method '>' {{(pid=112128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:34:05.781106 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: INFO nova.api.openstack.requestlog [None req-49a00128-8467-4281-9cc4-e0e32052c4c3 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.402043 Aug 24 07:34:05.781638 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: [pid: 112128|app: 0|req: 18/37] 10.222.0.42 () {60 vars in 1292 bytes} [Wed Aug 24 07:34:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:34:06.827657 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi [None req-3b267863-bd7a-4fe4-a4f5-efdf5451da16 admin admin] Calling method '>' {{(pid=112129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:34:06.828654 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: INFO nova.api.openstack.requestlog [None req-3b267863-bd7a-4fe4-a4f5-efdf5451da16 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Aug 24 07:34:06.829044 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: [pid: 112129|app: 0|req: 20/38] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Aug 24 07:34:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:34:07.346056 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi [None req-19ea4e57-c6af-4c59-963c-26aa1b5b28ec admin admin] Calling method '>' {{(pid=112128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:34:07.351642 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: INFO nova.api.openstack.wsgi [None req-19ea4e57-c6af-4c59-963c-26aa1b5b28ec admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 07:34:07.354949 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi [None req-19ea4e57-c6af-4c59-963c-26aa1b5b28ec admin admin] Request method failure captured: Aug 24 07:34:07.354949 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 07:34:07.354949 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: Accept: application/json Aug 24 07:34:07.354949 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: Accept-Encoding: gzip, deflate Aug 24 07:34:07.354949 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: Connection: keep-alive Aug 24 07:34:07.354949 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: Content-Length: 0 Aug 24 07:34:07.354949 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: Host: 10.222.0.42 Aug 24 07:34:07.354949 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: Openstack-Api-Version: compute 2.90 Aug 24 07:34:07.354949 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: Openstack-System-Scope: None Aug 24 07:34:07.354949 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: User-Agent: python-novaclient Aug 24 07:34:07.354949 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-Auth-Token: gAAAAABjBdRuC_PuhWln85IHLKR6G832V7C4gwLeho-LxjXM6gxcLd0xo-IyxfjmEJjcbXhBHIFsmBXJzluUWGqqvqlz16mOp561BMHreni3B2HHxWO6hdwihy4MNrFMto3URAol4YAlypA6CBTCncWcYHOGQNHywA_rIlH3beN6agLwYOOedWw Aug 24 07:34:07.354949 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-Domain-Id: None Aug 24 07:34:07.354949 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-Domain-Name: None Aug 24 07:34:07.354949 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-Identity-Status: Confirmed Aug 24 07:34:07.354949 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-Is-Admin-Project: True Aug 24 07:34:07.354949 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 07:34:07.354949 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-Project-Domain-Id: default Aug 24 07:34:07.354949 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-Project-Domain-Name: Default Aug 24 07:34:07.354949 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-Project-Id: 86fab351db604d94a6744cf147045d7e Aug 24 07:34:07.354949 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-Project-Name: admin Aug 24 07:34:07.354949 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-Role: admin,reader,member Aug 24 07:34:07.354949 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-Roles: admin,reader,member Aug 24 07:34:07.356603 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/86fab351db604d94a6744cf147045d7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_86fab351db604d94a6744cf147045d7e", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/86fab351db604d94a6744cf147045d7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/86fab351db604d94a6744cf147045d7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:34:07.356603 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-Tenant: admin Aug 24 07:34:07.356603 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-Tenant-Id: 86fab351db604d94a6744cf147045d7e Aug 24 07:34:07.356603 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-Tenant-Name: admin Aug 24 07:34:07.356603 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-User: admin Aug 24 07:34:07.356603 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-User-Domain-Id: default Aug 24 07:34:07.356603 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-User-Domain-Name: Default Aug 24 07:34:07.356603 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-User-Id: 11b0f239f5044e6880117c0daf3fe327 Aug 24 07:34:07.356603 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-User-Name: admin Aug 24 07:34:07.356603 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: method: > Aug 24 07:34:07.356603 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: exception: Flavor 42 could not be found. Aug 24 07:34:07.356603 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: action_args: {'id': '42'} Aug 24 07:34:07.356603 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: {{(pid=112128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:34:07.356603 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:34:07.357636 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 07:34:07.357636 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 07:34:07.357636 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 07:34:07.357636 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 07:34:07.357636 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 07:34:07.357636 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 07:34:07.357636 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 07:34:07.357636 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 07:34:07.357636 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 07:34:07.357636 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:34:07.357636 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 07:34:07.357636 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 07:34:07.357636 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 07:34:07.357636 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi Aug 24 07:34:07.357636 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:34:07.357636 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi Aug 24 07:34:07.357636 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:34:07.357636 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:34:07.357636 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:34:07.358889 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:34:07.358889 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:34:07.358889 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:34:07.358889 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:34:07.358889 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 07:34:07.358889 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:34:07.358889 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 07:34:07.358889 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi Aug 24 07:34:07.358889 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:34:07.358889 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi Aug 24 07:34:07.358889 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:34:07.358889 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:34:07.358889 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:34:07.358889 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:34:07.358889 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:34:07.358889 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 07:34:07.358889 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi Aug 24 07:34:07.358889 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi [None req-19ea4e57-c6af-4c59-963c-26aa1b5b28ec admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:34:07.359920 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: INFO nova.api.openstack.requestlog [None req-19ea4e57-c6af-4c59-963c-26aa1b5b28ec admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.392484 Aug 24 07:34:07.359920 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: [pid: 112128|app: 0|req: 19/39] 10.222.0.42 () {60 vars in 1190 bytes} [Wed Aug 24 07:34:06 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 07:34:07.365993 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi [None req-44befe58-0f7a-4701-ae1a-79665262e263 admin admin] Calling method '>' {{(pid=112129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:34:07.370755 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG dbcounter [-] [112129] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=112129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:34:07.390363 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: INFO nova.api.openstack.requestlog [None req-44befe58-0f7a-4701-ae1a-79665262e263 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027865 Aug 24 07:34:07.390938 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: [pid: 112129|app: 0|req: 21/40] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Aug 24 07:34:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:34:07.400470 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi [None req-ab347419-86e2-46cc-b8a1-d5bb5d6a1212 admin admin] Calling method '>' {{(pid=112128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:34:07.425417 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: INFO nova.api.openstack.requestlog [None req-ab347419-86e2-46cc-b8a1-d5bb5d6a1212 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028451 Aug 24 07:34:07.425960 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: [pid: 112128|app: 0|req: 20/41] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Aug 24 07:34:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:34:07.436406 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi [None req-2e5d16d1-a6c7-4872-8895-8fa01a3b9617 admin admin] Calling method '>' {{(pid=112129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:34:07.442757 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: INFO nova.api.openstack.wsgi [None req-2e5d16d1-a6c7-4872-8895-8fa01a3b9617 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 07:34:07.446607 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi [None req-2e5d16d1-a6c7-4872-8895-8fa01a3b9617 admin admin] Request method failure captured: Aug 24 07:34:07.446607 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 07:34:07.446607 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: Accept: application/json Aug 24 07:34:07.446607 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: Accept-Encoding: gzip, deflate Aug 24 07:34:07.446607 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: Connection: keep-alive Aug 24 07:34:07.446607 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: Content-Length: 0 Aug 24 07:34:07.446607 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: Host: 10.222.0.42 Aug 24 07:34:07.446607 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: Openstack-Api-Version: compute 2.90 Aug 24 07:34:07.446607 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: Openstack-System-Scope: None Aug 24 07:34:07.446607 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: User-Agent: python-novaclient Aug 24 07:34:07.446607 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-Auth-Token: gAAAAABjBdRuC_PuhWln85IHLKR6G832V7C4gwLeho-LxjXM6gxcLd0xo-IyxfjmEJjcbXhBHIFsmBXJzluUWGqqvqlz16mOp561BMHreni3B2HHxWO6hdwihy4MNrFMto3URAol4YAlypA6CBTCncWcYHOGQNHywA_rIlH3beN6agLwYOOedWw Aug 24 07:34:07.446607 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-Domain-Id: None Aug 24 07:34:07.446607 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-Domain-Name: None Aug 24 07:34:07.446607 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-Identity-Status: Confirmed Aug 24 07:34:07.446607 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-Is-Admin-Project: True Aug 24 07:34:07.446607 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 07:34:07.446607 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-Project-Domain-Id: default Aug 24 07:34:07.446607 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-Project-Domain-Name: Default Aug 24 07:34:07.446607 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-Project-Id: 86fab351db604d94a6744cf147045d7e Aug 24 07:34:07.446607 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-Project-Name: admin Aug 24 07:34:07.446607 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-Role: admin,reader,member Aug 24 07:34:07.446607 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-Roles: admin,reader,member Aug 24 07:34:07.448123 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/86fab351db604d94a6744cf147045d7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_86fab351db604d94a6744cf147045d7e", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/86fab351db604d94a6744cf147045d7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/86fab351db604d94a6744cf147045d7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:34:07.448123 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-Tenant: admin Aug 24 07:34:07.448123 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-Tenant-Id: 86fab351db604d94a6744cf147045d7e Aug 24 07:34:07.448123 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-Tenant-Name: admin Aug 24 07:34:07.448123 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-User: admin Aug 24 07:34:07.448123 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-User-Domain-Id: default Aug 24 07:34:07.448123 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-User-Domain-Name: Default Aug 24 07:34:07.448123 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-User-Id: 11b0f239f5044e6880117c0daf3fe327 Aug 24 07:34:07.448123 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-User-Name: admin Aug 24 07:34:07.448123 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: method: > Aug 24 07:34:07.448123 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: exception: Flavor 42 could not be found. Aug 24 07:34:07.448123 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: action_args: {'id': '42'} Aug 24 07:34:07.448123 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: {{(pid=112129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:34:07.448123 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:34:07.449110 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 07:34:07.449110 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 07:34:07.449110 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 07:34:07.449110 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 07:34:07.449110 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 07:34:07.449110 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 07:34:07.449110 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 07:34:07.449110 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 07:34:07.449110 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 07:34:07.449110 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:34:07.449110 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 07:34:07.449110 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 07:34:07.449110 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 07:34:07.449110 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi Aug 24 07:34:07.449110 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:34:07.449110 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi Aug 24 07:34:07.449110 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:34:07.449110 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:34:07.449110 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:34:07.450321 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:34:07.450321 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:34:07.450321 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:34:07.450321 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:34:07.450321 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 07:34:07.450321 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:34:07.450321 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 07:34:07.450321 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi Aug 24 07:34:07.450321 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:34:07.450321 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi Aug 24 07:34:07.450321 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:34:07.450321 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:34:07.450321 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:34:07.450321 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:34:07.450321 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:34:07.450321 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 07:34:07.450321 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi Aug 24 07:34:07.450321 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi [None req-2e5d16d1-a6c7-4872-8895-8fa01a3b9617 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:34:07.451576 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: INFO nova.api.openstack.requestlog [None req-2e5d16d1-a6c7-4872-8895-8fa01a3b9617 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015805 Aug 24 07:34:07.451576 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: [pid: 112129|app: 0|req: 22/42] 10.222.0.42 () {60 vars in 1190 bytes} [Wed Aug 24 07:34:07 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 24 07:34:08.405036 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi [None req-ab347419-86e2-46cc-b8a1-d5bb5d6a1212 admin admin] Calling method '>' {{(pid=112128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:34:08.406050 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: INFO nova.api.openstack.requestlog [None req-ab347419-86e2-46cc-b8a1-d5bb5d6a1212 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Aug 24 07:34:08.406442 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: [pid: 112128|app: 0|req: 21/43] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Aug 24 07:34:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:34:08.926128 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi [None req-343004fc-a3af-4c16-bc62-12080cf18dd5 admin admin] Calling method '>' {{(pid=112129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:34:08.932118 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: INFO nova.api.openstack.wsgi [None req-343004fc-a3af-4c16-bc62-12080cf18dd5 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 07:34:08.933643 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi [None req-343004fc-a3af-4c16-bc62-12080cf18dd5 admin admin] Request method failure captured: Aug 24 07:34:08.933643 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 07:34:08.933643 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: Accept: application/json Aug 24 07:34:08.933643 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: Accept-Encoding: gzip, deflate Aug 24 07:34:08.933643 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: Connection: keep-alive Aug 24 07:34:08.933643 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: Content-Length: 0 Aug 24 07:34:08.933643 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: Host: 10.222.0.42 Aug 24 07:34:08.933643 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: Openstack-Api-Version: compute 2.90 Aug 24 07:34:08.933643 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: Openstack-System-Scope: None Aug 24 07:34:08.933643 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: User-Agent: python-novaclient Aug 24 07:34:08.933643 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-Auth-Token: gAAAAABjBdRwqZHwiPpSBEu80QolR1GUBsMWjYlis_Q97fFI5U-O81K2m8fh93IlrT2W6U-qIA3Y1I2mF0-TZl5GSjfbR6ipYntxs6jeucDdlyKO0tYZc-iCSo1AKwvnHBMSjk0ELtyRIOSXoGSZSeW6ZROANU8ieB3AJef8fjjU9520aKnznUc Aug 24 07:34:08.933643 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-Domain-Id: None Aug 24 07:34:08.933643 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-Domain-Name: None Aug 24 07:34:08.933643 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-Identity-Status: Confirmed Aug 24 07:34:08.933643 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-Is-Admin-Project: True Aug 24 07:34:08.933643 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 07:34:08.933643 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-Project-Domain-Id: default Aug 24 07:34:08.933643 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-Project-Domain-Name: Default Aug 24 07:34:08.933643 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-Project-Id: 86fab351db604d94a6744cf147045d7e Aug 24 07:34:08.933643 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-Project-Name: admin Aug 24 07:34:08.933643 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-Role: admin,reader,member Aug 24 07:34:08.933643 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-Roles: admin,reader,member Aug 24 07:34:08.935221 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/86fab351db604d94a6744cf147045d7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_86fab351db604d94a6744cf147045d7e", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/86fab351db604d94a6744cf147045d7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/86fab351db604d94a6744cf147045d7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:34:08.935221 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-Tenant: admin Aug 24 07:34:08.935221 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-Tenant-Id: 86fab351db604d94a6744cf147045d7e Aug 24 07:34:08.935221 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-Tenant-Name: admin Aug 24 07:34:08.935221 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-User: admin Aug 24 07:34:08.935221 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-User-Domain-Id: default Aug 24 07:34:08.935221 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-User-Domain-Name: Default Aug 24 07:34:08.935221 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-User-Id: 11b0f239f5044e6880117c0daf3fe327 Aug 24 07:34:08.935221 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-User-Name: admin Aug 24 07:34:08.935221 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: method: > Aug 24 07:34:08.935221 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: exception: Flavor 84 could not be found. Aug 24 07:34:08.935221 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: action_args: {'id': '84'} Aug 24 07:34:08.935221 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: {{(pid=112129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:34:08.935221 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:34:08.936119 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 07:34:08.936119 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 07:34:08.936119 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 07:34:08.936119 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 07:34:08.936119 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 07:34:08.936119 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 07:34:08.936119 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 07:34:08.936119 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 07:34:08.936119 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 07:34:08.936119 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:34:08.936119 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 07:34:08.936119 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 07:34:08.936119 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 07:34:08.936119 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi Aug 24 07:34:08.936119 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:34:08.936119 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi Aug 24 07:34:08.936119 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:34:08.936119 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:34:08.936119 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:34:08.937403 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:34:08.937403 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:34:08.937403 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:34:08.937403 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:34:08.937403 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 07:34:08.937403 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:34:08.937403 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 07:34:08.937403 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi Aug 24 07:34:08.937403 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:34:08.937403 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi Aug 24 07:34:08.937403 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:34:08.937403 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:34:08.937403 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:34:08.937403 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:34:08.937403 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:34:08.937403 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 07:34:08.937403 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi Aug 24 07:34:08.937403 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi [None req-343004fc-a3af-4c16-bc62-12080cf18dd5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:34:08.938625 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: INFO nova.api.openstack.requestlog [None req-343004fc-a3af-4c16-bc62-12080cf18dd5 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.393789 Aug 24 07:34:08.938625 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: [pid: 112129|app: 0|req: 23/44] 10.222.0.42 () {60 vars in 1190 bytes} [Wed Aug 24 07:34:08 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 07:34:08.945278 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi [None req-892fbb26-b3a1-42e2-93bb-51b14a5a53a3 admin admin] Calling method '>' {{(pid=112128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:34:08.959957 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: INFO nova.api.openstack.requestlog [None req-892fbb26-b3a1-42e2-93bb-51b14a5a53a3 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018882 Aug 24 07:34:08.960503 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: [pid: 112128|app: 0|req: 22/45] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Aug 24 07:34:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:34:08.970289 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi [None req-c160c5d6-0b2e-4bde-9833-637b2d05877b admin admin] Calling method '>' {{(pid=112129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:34:08.985052 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: INFO nova.api.openstack.requestlog [None req-c160c5d6-0b2e-4bde-9833-637b2d05877b admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018408 Aug 24 07:34:08.985565 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: [pid: 112129|app: 0|req: 24/46] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Aug 24 07:34:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 07:34:08.995127 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi [None req-d0c5fc01-ade3-4a0b-86ef-975209391805 admin admin] Calling method '>' {{(pid=112128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:34:09.000382 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: INFO nova.api.openstack.wsgi [None req-d0c5fc01-ade3-4a0b-86ef-975209391805 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 07:34:09.001864 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi [None req-d0c5fc01-ade3-4a0b-86ef-975209391805 admin admin] Request method failure captured: Aug 24 07:34:09.001864 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 07:34:09.001864 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: Accept: application/json Aug 24 07:34:09.001864 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: Accept-Encoding: gzip, deflate Aug 24 07:34:09.001864 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: Connection: keep-alive Aug 24 07:34:09.001864 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: Content-Length: 0 Aug 24 07:34:09.001864 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: Host: 10.222.0.42 Aug 24 07:34:09.001864 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: Openstack-Api-Version: compute 2.90 Aug 24 07:34:09.001864 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: Openstack-System-Scope: None Aug 24 07:34:09.001864 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: User-Agent: python-novaclient Aug 24 07:34:09.001864 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-Auth-Token: gAAAAABjBdRwqZHwiPpSBEu80QolR1GUBsMWjYlis_Q97fFI5U-O81K2m8fh93IlrT2W6U-qIA3Y1I2mF0-TZl5GSjfbR6ipYntxs6jeucDdlyKO0tYZc-iCSo1AKwvnHBMSjk0ELtyRIOSXoGSZSeW6ZROANU8ieB3AJef8fjjU9520aKnznUc Aug 24 07:34:09.001864 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-Domain-Id: None Aug 24 07:34:09.001864 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-Domain-Name: None Aug 24 07:34:09.001864 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-Identity-Status: Confirmed Aug 24 07:34:09.001864 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-Is-Admin-Project: True Aug 24 07:34:09.001864 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 07:34:09.001864 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-Project-Domain-Id: default Aug 24 07:34:09.001864 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-Project-Domain-Name: Default Aug 24 07:34:09.001864 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-Project-Id: 86fab351db604d94a6744cf147045d7e Aug 24 07:34:09.001864 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-Project-Name: admin Aug 24 07:34:09.001864 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-Role: admin,reader,member Aug 24 07:34:09.001864 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-Roles: admin,reader,member Aug 24 07:34:09.003409 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/86fab351db604d94a6744cf147045d7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_86fab351db604d94a6744cf147045d7e", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/86fab351db604d94a6744cf147045d7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/86fab351db604d94a6744cf147045d7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:34:09.003409 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-Tenant: admin Aug 24 07:34:09.003409 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-Tenant-Id: 86fab351db604d94a6744cf147045d7e Aug 24 07:34:09.003409 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-Tenant-Name: admin Aug 24 07:34:09.003409 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-User: admin Aug 24 07:34:09.003409 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-User-Domain-Id: default Aug 24 07:34:09.003409 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-User-Domain-Name: Default Aug 24 07:34:09.003409 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-User-Id: 11b0f239f5044e6880117c0daf3fe327 Aug 24 07:34:09.003409 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-User-Name: admin Aug 24 07:34:09.003409 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: method: > Aug 24 07:34:09.003409 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: exception: Flavor 84 could not be found. Aug 24 07:34:09.003409 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: action_args: {'id': '84'} Aug 24 07:34:09.003409 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: {{(pid=112128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:34:09.003409 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:34:09.004248 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 07:34:09.004248 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 07:34:09.004248 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 07:34:09.004248 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 07:34:09.004248 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 07:34:09.004248 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 07:34:09.004248 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 07:34:09.004248 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 07:34:09.004248 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 07:34:09.004248 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:34:09.004248 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 07:34:09.004248 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 07:34:09.004248 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 07:34:09.004248 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi Aug 24 07:34:09.004248 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:34:09.004248 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi Aug 24 07:34:09.004248 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:34:09.004248 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:34:09.004248 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:34:09.005504 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:34:09.005504 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:34:09.005504 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:34:09.005504 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:34:09.005504 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 07:34:09.005504 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:34:09.005504 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 07:34:09.005504 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi Aug 24 07:34:09.005504 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:34:09.005504 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi Aug 24 07:34:09.005504 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:34:09.005504 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:34:09.005504 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:34:09.005504 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:34:09.005504 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:34:09.005504 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 07:34:09.005504 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi Aug 24 07:34:09.005504 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi [None req-d0c5fc01-ade3-4a0b-86ef-975209391805 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:34:09.006539 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: INFO nova.api.openstack.requestlog [None req-d0c5fc01-ade3-4a0b-86ef-975209391805 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012189 Aug 24 07:34:09.006539 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: [pid: 112128|app: 0|req: 23/47] 10.222.0.42 () {60 vars in 1190 bytes} [Wed Aug 24 07:34:08 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 07:34:09.972948 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi [None req-c160c5d6-0b2e-4bde-9833-637b2d05877b admin admin] Calling method '>' {{(pid=112129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:34:09.973948 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: INFO nova.api.openstack.requestlog [None req-c160c5d6-0b2e-4bde-9833-637b2d05877b admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Aug 24 07:34:09.974341 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: [pid: 112129|app: 0|req: 25/48] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Aug 24 07:34:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:34:10.493207 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi [None req-7d98aa35-b1c9-4f03-9ea3-c6c7bf566aee admin admin] Calling method '>' {{(pid=112128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:34:10.498861 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: INFO nova.api.openstack.wsgi [None req-7d98aa35-b1c9-4f03-9ea3-c6c7bf566aee admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 07:34:10.500353 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi [None req-7d98aa35-b1c9-4f03-9ea3-c6c7bf566aee admin admin] Request method failure captured: Aug 24 07:34:10.500353 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 07:34:10.500353 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: Accept: application/json Aug 24 07:34:10.500353 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: Accept-Encoding: gzip, deflate Aug 24 07:34:10.500353 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: Connection: keep-alive Aug 24 07:34:10.500353 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: Content-Length: 0 Aug 24 07:34:10.500353 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: Host: 10.222.0.42 Aug 24 07:34:10.500353 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: Openstack-Api-Version: compute 2.90 Aug 24 07:34:10.500353 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: Openstack-System-Scope: None Aug 24 07:34:10.500353 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: User-Agent: python-novaclient Aug 24 07:34:10.500353 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-Auth-Token: gAAAAABjBdRxnTyxW5MEQmzVpo6kUdeEqzkib3LDfWT5TQbSixnVP-q82jjUdBq7cpfKhv5oJ3_kGOCHx8CgFt2qVsfhNaH0gvHdL22WbWlaFffqKZvDKY1X_73uinI1wNp4rfx3UDDx_M10SQ0TzF8AHLqAba4XL0GMLMnL5tDmD1M10VIooww Aug 24 07:34:10.500353 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-Domain-Id: None Aug 24 07:34:10.500353 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-Domain-Name: None Aug 24 07:34:10.500353 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-Identity-Status: Confirmed Aug 24 07:34:10.500353 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-Is-Admin-Project: True Aug 24 07:34:10.500353 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 07:34:10.500353 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-Project-Domain-Id: default Aug 24 07:34:10.500353 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-Project-Domain-Name: Default Aug 24 07:34:10.500353 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-Project-Id: 86fab351db604d94a6744cf147045d7e Aug 24 07:34:10.500353 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-Project-Name: admin Aug 24 07:34:10.500353 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-Role: admin,reader,member Aug 24 07:34:10.500353 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-Roles: admin,reader,member Aug 24 07:34:10.501902 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/86fab351db604d94a6744cf147045d7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_86fab351db604d94a6744cf147045d7e", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/86fab351db604d94a6744cf147045d7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/86fab351db604d94a6744cf147045d7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:34:10.501902 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-Tenant: admin Aug 24 07:34:10.501902 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-Tenant-Id: 86fab351db604d94a6744cf147045d7e Aug 24 07:34:10.501902 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-Tenant-Name: admin Aug 24 07:34:10.501902 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-User: admin Aug 24 07:34:10.501902 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-User-Domain-Id: default Aug 24 07:34:10.501902 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-User-Domain-Name: Default Aug 24 07:34:10.501902 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-User-Id: 11b0f239f5044e6880117c0daf3fe327 Aug 24 07:34:10.501902 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: X-User-Name: admin Aug 24 07:34:10.501902 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: method: > Aug 24 07:34:10.501902 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: exception: Flavor 451 could not be found. Aug 24 07:34:10.501902 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: action_args: {'id': '451'} Aug 24 07:34:10.501902 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: {{(pid=112128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:34:10.501902 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:34:10.502987 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 07:34:10.502987 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 07:34:10.502987 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 07:34:10.502987 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 07:34:10.502987 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 07:34:10.502987 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 07:34:10.502987 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 07:34:10.502987 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 07:34:10.502987 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 07:34:10.502987 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:34:10.502987 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 07:34:10.502987 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 07:34:10.502987 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 07:34:10.502987 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi Aug 24 07:34:10.502987 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:34:10.502987 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi Aug 24 07:34:10.502987 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:34:10.502987 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:34:10.502987 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:34:10.504545 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:34:10.504545 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:34:10.504545 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:34:10.504545 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:34:10.504545 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 07:34:10.504545 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:34:10.504545 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 07:34:10.504545 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi Aug 24 07:34:10.504545 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:34:10.504545 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi Aug 24 07:34:10.504545 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:34:10.504545 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:34:10.504545 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:34:10.504545 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:34:10.504545 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:34:10.504545 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 07:34:10.504545 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: ERROR nova.api.openstack.wsgi Aug 24 07:34:10.504545 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi [None req-7d98aa35-b1c9-4f03-9ea3-c6c7bf566aee admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:34:10.505763 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: INFO nova.api.openstack.requestlog [None req-7d98aa35-b1c9-4f03-9ea3-c6c7bf566aee admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.392465 Aug 24 07:34:10.505763 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: [pid: 112128|app: 0|req: 24/49] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Aug 24 07:34:10 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 07:34:10.511878 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi [None req-e545cb3f-e05e-45c1-9b9b-8d6875adbf19 admin admin] Calling method '>' {{(pid=112129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:34:10.526465 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: INFO nova.api.openstack.requestlog [None req-e545cb3f-e05e-45c1-9b9b-8d6875adbf19 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018084 Aug 24 07:34:10.527009 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: [pid: 112129|app: 0|req: 26/50] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Aug 24 07:34:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 07:34:10.536170 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi [None req-ff4ca421-517b-497b-a958-fd7e39f1b0d8 admin admin] Calling method '>' {{(pid=112128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:34:10.550546 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: INFO nova.api.openstack.requestlog [None req-ff4ca421-517b-497b-a958-fd7e39f1b0d8 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017814 Aug 24 07:34:10.551093 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: [pid: 112128|app: 0|req: 25/51] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Aug 24 07:34:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:34:10.560515 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi [None req-834e6321-5a3e-4752-bf04-fd9b7f66d860 admin admin] Calling method '>' {{(pid=112129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:34:10.565700 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: INFO nova.api.openstack.wsgi [None req-834e6321-5a3e-4752-bf04-fd9b7f66d860 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 07:34:10.567246 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi [None req-834e6321-5a3e-4752-bf04-fd9b7f66d860 admin admin] Request method failure captured: Aug 24 07:34:10.567246 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 07:34:10.567246 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: Accept: application/json Aug 24 07:34:10.567246 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: Accept-Encoding: gzip, deflate Aug 24 07:34:10.567246 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: Connection: keep-alive Aug 24 07:34:10.567246 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: Content-Length: 0 Aug 24 07:34:10.567246 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: Host: 10.222.0.42 Aug 24 07:34:10.567246 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: Openstack-Api-Version: compute 2.90 Aug 24 07:34:10.567246 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: Openstack-System-Scope: None Aug 24 07:34:10.567246 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: User-Agent: python-novaclient Aug 24 07:34:10.567246 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-Auth-Token: gAAAAABjBdRxnTyxW5MEQmzVpo6kUdeEqzkib3LDfWT5TQbSixnVP-q82jjUdBq7cpfKhv5oJ3_kGOCHx8CgFt2qVsfhNaH0gvHdL22WbWlaFffqKZvDKY1X_73uinI1wNp4rfx3UDDx_M10SQ0TzF8AHLqAba4XL0GMLMnL5tDmD1M10VIooww Aug 24 07:34:10.567246 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-Domain-Id: None Aug 24 07:34:10.567246 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-Domain-Name: None Aug 24 07:34:10.567246 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-Identity-Status: Confirmed Aug 24 07:34:10.567246 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-Is-Admin-Project: True Aug 24 07:34:10.567246 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 07:34:10.567246 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-Project-Domain-Id: default Aug 24 07:34:10.567246 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-Project-Domain-Name: Default Aug 24 07:34:10.567246 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-Project-Id: 86fab351db604d94a6744cf147045d7e Aug 24 07:34:10.567246 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-Project-Name: admin Aug 24 07:34:10.567246 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-Role: admin,reader,member Aug 24 07:34:10.567246 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-Roles: admin,reader,member Aug 24 07:34:10.568833 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/86fab351db604d94a6744cf147045d7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_86fab351db604d94a6744cf147045d7e", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/86fab351db604d94a6744cf147045d7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/86fab351db604d94a6744cf147045d7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:34:10.568833 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-Tenant: admin Aug 24 07:34:10.568833 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-Tenant-Id: 86fab351db604d94a6744cf147045d7e Aug 24 07:34:10.568833 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-Tenant-Name: admin Aug 24 07:34:10.568833 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-User: admin Aug 24 07:34:10.568833 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-User-Domain-Id: default Aug 24 07:34:10.568833 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-User-Domain-Name: Default Aug 24 07:34:10.568833 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-User-Id: 11b0f239f5044e6880117c0daf3fe327 Aug 24 07:34:10.568833 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: X-User-Name: admin Aug 24 07:34:10.568833 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: method: > Aug 24 07:34:10.568833 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: exception: Flavor 451 could not be found. Aug 24 07:34:10.568833 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: action_args: {'id': '451'} Aug 24 07:34:10.568833 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: {{(pid=112129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:34:10.568833 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:34:10.569665 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 07:34:10.569665 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 07:34:10.569665 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 07:34:10.569665 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 07:34:10.569665 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 07:34:10.569665 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 07:34:10.569665 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 07:34:10.569665 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 07:34:10.569665 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 07:34:10.569665 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:34:10.569665 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 07:34:10.569665 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 07:34:10.569665 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 07:34:10.569665 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi Aug 24 07:34:10.569665 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:34:10.569665 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi Aug 24 07:34:10.569665 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:34:10.569665 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:34:10.569665 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:34:10.572305 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:34:10.572305 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:34:10.572305 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:34:10.572305 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:34:10.572305 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 07:34:10.572305 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:34:10.572305 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 07:34:10.572305 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi Aug 24 07:34:10.572305 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:34:10.572305 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi Aug 24 07:34:10.572305 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:34:10.572305 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:34:10.572305 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:34:10.572305 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:34:10.572305 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:34:10.572305 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 07:34:10.572305 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: ERROR nova.api.openstack.wsgi Aug 24 07:34:10.572305 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi [None req-834e6321-5a3e-4752-bf04-fd9b7f66d860 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:34:10.573539 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: INFO nova.api.openstack.requestlog [None req-834e6321-5a3e-4752-bf04-fd9b7f66d860 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011606 Aug 24 07:34:10.573539 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: [pid: 112129|app: 0|req: 27/52] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Aug 24 07:34:10 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 07:34:11.531672 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi [None req-ff4ca421-517b-497b-a958-fd7e39f1b0d8 admin admin] Calling method '>' {{(pid=112128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:34:11.532680 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: INFO nova.api.openstack.requestlog [None req-ff4ca421-517b-497b-a958-fd7e39f1b0d8 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001607 Aug 24 07:34:11.533080 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: [pid: 112128|app: 0|req: 26/53] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Aug 24 07:34:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:34:12.051387 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi [None req-eb8e9236-4e1d-4e04-af04-aa9b1565a1eb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:34:12.070993 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: INFO nova.api.openstack.requestlog [None req-eb8e9236-4e1d-4e04-af04-aa9b1565a1eb admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.400451 Aug 24 07:34:12.071521 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: [pid: 112129|app: 0|req: 28/54] 10.222.0.42 () {64 vars in 1235 bytes} [Wed Aug 24 07:34:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 07:34:13.032475 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi [None req-ff4ca421-517b-497b-a958-fd7e39f1b0d8 admin admin] Calling method '>' {{(pid=112128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:34:13.033517 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: INFO nova.api.openstack.requestlog [None req-ff4ca421-517b-497b-a958-fd7e39f1b0d8 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Aug 24 07:34:13.033947 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: [pid: 112128|app: 0|req: 27/55] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Aug 24 07:34:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:34:13.556670 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi [None req-2e2b7440-02fd-4eb5-a596-df3e360ab1dd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:34:13.575115 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: INFO nova.api.openstack.requestlog [None req-2e2b7440-02fd-4eb5-a596-df3e360ab1dd admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.403605 Aug 24 07:34:13.575650 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: [pid: 112129|app: 0|req: 29/56] 10.222.0.42 () {64 vars in 1235 bytes} [Wed Aug 24 07:34:13 2022] POST /compute/v2.1/flavors => generated 405 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 07:34:14.535639 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi [None req-ff4ca421-517b-497b-a958-fd7e39f1b0d8 admin admin] Calling method '>' {{(pid=112128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:34:14.536653 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: INFO nova.api.openstack.requestlog [None req-ff4ca421-517b-497b-a958-fd7e39f1b0d8 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Aug 24 07:34:14.537050 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: [pid: 112128|app: 0|req: 28/57] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Aug 24 07:34:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:34:15.062055 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi [None req-fbd5f8e0-3583-4cde-8f33-1a1aa09dbfea admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:34:15.081105 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: INFO nova.api.openstack.requestlog [None req-fbd5f8e0-3583-4cde-8f33-1a1aa09dbfea admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.406858 Aug 24 07:34:15.081636 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: [pid: 112129|app: 0|req: 30/58] 10.222.0.42 () {64 vars in 1235 bytes} [Wed Aug 24 07:34:14 2022] POST /compute/v2.1/flavors => generated 407 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 07:34:16.053211 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi [None req-ff4ca421-517b-497b-a958-fd7e39f1b0d8 admin admin] Calling method '>' {{(pid=112128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:34:16.054211 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: INFO nova.api.openstack.requestlog [None req-ff4ca421-517b-497b-a958-fd7e39f1b0d8 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Aug 24 07:34:16.054630 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: [pid: 112128|app: 0|req: 29/59] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Aug 24 07:34:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:34:16.572195 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi [None req-ab42731f-9786-421b-b18d-705f1cdeceb5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:34:16.594737 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: INFO nova.api.openstack.requestlog [None req-ab42731f-9786-421b-b18d-705f1cdeceb5 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.403232 Aug 24 07:34:16.595148 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: [pid: 112129|app: 0|req: 31/60] 10.222.0.42 () {64 vars in 1235 bytes} [Wed Aug 24 07:34:16 2022] POST /compute/v2.1/flavors => generated 409 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 07:34:17.552827 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi [None req-ff4ca421-517b-497b-a958-fd7e39f1b0d8 admin admin] Calling method '>' {{(pid=112128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:34:17.553840 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: INFO nova.api.openstack.requestlog [None req-ff4ca421-517b-497b-a958-fd7e39f1b0d8 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 24 07:34:17.554242 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: [pid: 112128|app: 0|req: 30/61] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Aug 24 07:34:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:34:18.080184 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi [None req-69f1c11c-6b9b-44de-86bd-98b2f15c2a07 admin admin] Calling method '>' {{(pid=112129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:34:18.100808 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: INFO nova.api.openstack.requestlog [None req-69f1c11c-6b9b-44de-86bd-98b2f15c2a07 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.405436 Aug 24 07:34:18.101501 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: [pid: 112129|app: 0|req: 32/62] 10.222.0.42 () {60 vars in 1202 bytes} [Wed Aug 24 07:34:17 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:35:10.986563 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi [None req-ff4ca421-517b-497b-a958-fd7e39f1b0d8 admin admin] Calling method '>' {{(pid=112128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:35:10.987623 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: INFO nova.api.openstack.requestlog [None req-ff4ca421-517b-497b-a958-fd7e39f1b0d8 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Aug 24 07:35:10.988033 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: [pid: 112128|app: 0|req: 31/63] 10.222.0.42 () {54 vars in 931 bytes} [Wed Aug 24 07:35:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:35:10.998734 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG dbcounter [-] [112129] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=112129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:11.377127 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi [None req-fa101324-e552-415a-8530-57fd1717ade7 admin admin] Calling method '>' {{(pid=112129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:35:11.397863 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: INFO nova.api.openstack.requestlog [None req-fa101324-e552-415a-8530-57fd1717ade7 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.403560 Aug 24 07:35:11.398404 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: [pid: 112129|app: 0|req: 33/64] 10.222.0.42 () {60 vars in 1292 bytes} [Wed Aug 24 07:35:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:35:11.419380 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG dbcounter [-] [112128] Writing DB stats nova_api:SELECT=14 {{(pid=112128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:35:11.423076 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi [None req-a024bc9b-6fb6-4ee1-ae6e-9dc39d7557b7 admin admin] Calling method '>' {{(pid=112128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:35:11.430946 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: INFO nova.api.openstack.requestlog [None req-a024bc9b-6fb6-4ee1-ae6e-9dc39d7557b7 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013049 Aug 24 07:35:11.431457 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: [pid: 112128|app: 0|req: 32/65] 10.222.0.42 () {60 vars in 1283 bytes} [Wed Aug 24 07:35:11 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:35:11.443442 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi [None req-a72fad4a-5551-4339-b736-6ff2441464e4 admin admin] Calling method '>' {{(pid=112129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:35:11.451158 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: INFO nova.api.openstack.requestlog [None req-a72fad4a-5551-4339-b736-6ff2441464e4 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011207 Aug 24 07:35:11.452265 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: [pid: 112129|app: 0|req: 34/66] 10.222.0.42 () {60 vars in 1286 bytes} [Wed Aug 24 07:35:11 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:35:11.463657 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi [None req-58383e37-51df-4b74-8d3d-264be1ea1eec admin admin] Calling method '>' {{(pid=112128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:35:11.471074 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: INFO nova.api.openstack.requestlog [None req-58383e37-51df-4b74-8d3d-264be1ea1eec admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010790 Aug 24 07:35:11.471585 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: [pid: 112128|app: 0|req: 33/67] 10.222.0.42 () {60 vars in 1286 bytes} [Wed Aug 24 07:35:11 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:35:11.482729 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi [None req-1875ddb8-dc94-4028-92b4-39b5ba628e01 admin admin] Calling method '>' {{(pid=112129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:35:11.490106 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: INFO nova.api.openstack.requestlog [None req-1875ddb8-dc94-4028-92b4-39b5ba628e01 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010862 Aug 24 07:35:11.490638 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: [pid: 112129|app: 0|req: 35/68] 10.222.0.42 () {60 vars in 1283 bytes} [Wed Aug 24 07:35:11 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:38:12.057854 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi [None req-58383e37-51df-4b74-8d3d-264be1ea1eec admin admin] Calling method '>' {{(pid=112128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:38:12.058894 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: INFO nova.api.openstack.requestlog [None req-58383e37-51df-4b74-8d3d-264be1ea1eec admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 24 07:38:12.059285 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: [pid: 112128|app: 0|req: 34/69] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Aug 24 07:38:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:38:12.198040 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG dbcounter [-] [112129] Writing DB stats nova_api:SELECT=6 {{(pid=112129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:38:12.356679 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi [None req-60a4e0e1-14cc-4a8d-8222-42c081dea520 admin admin] Calling method '>' {{(pid=112129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:38:12.358992 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:38:12.358992 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: warnings.warn(msg) Aug 24 07:38:12.360125 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG oslo_concurrency.lockutils [None req-60a4e0e1-14cc-4a8d-8222-42c081dea520 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:38:12.360599 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG oslo_concurrency.lockutils [None req-60a4e0e1-14cc-4a8d-8222-42c081dea520 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:38:12.361052 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG oslo_concurrency.lockutils [None req-60a4e0e1-14cc-4a8d-8222-42c081dea520 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:38:12.361764 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG oslo_concurrency.lockutils [None req-60a4e0e1-14cc-4a8d-8222-42c081dea520 admin admin] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:38:12.362204 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG oslo_concurrency.lockutils [None req-60a4e0e1-14cc-4a8d-8222-42c081dea520 admin admin] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:38:12.362620 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG oslo_concurrency.lockutils [None req-60a4e0e1-14cc-4a8d-8222-42c081dea520 admin admin] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:38:12.396970 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: INFO nova.api.openstack.requestlog [None req-60a4e0e1-14cc-4a8d-8222-42c081dea520 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.200299 Aug 24 07:38:12.397543 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: [pid: 112129|app: 0|req: 36/70] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Aug 24 07:38:12 2022] GET /compute/v2.1/os-services => generated 791 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 07:38:13.221825 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi [None req-58383e37-51df-4b74-8d3d-264be1ea1eec admin admin] Calling method '>' {{(pid=112128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:38:13.222854 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: INFO nova.api.openstack.requestlog [None req-58383e37-51df-4b74-8d3d-264be1ea1eec admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Aug 24 07:38:13.223248 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: [pid: 112128|app: 0|req: 35/71] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Aug 24 07:38:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:38:13.417203 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi [None req-6f7dd855-f2ac-43e6-842b-41e44cdbe1a9 admin admin] Calling method '>' {{(pid=112129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:38:13.419659 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:38:13.419659 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: warnings.warn(msg) Aug 24 07:38:13.420747 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG oslo_concurrency.lockutils [None req-6f7dd855-f2ac-43e6-842b-41e44cdbe1a9 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:38:13.421214 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG oslo_concurrency.lockutils [None req-6f7dd855-f2ac-43e6-842b-41e44cdbe1a9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:38:13.421639 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG oslo_concurrency.lockutils [None req-6f7dd855-f2ac-43e6-842b-41e44cdbe1a9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:38:13.422338 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG oslo_concurrency.lockutils [None req-6f7dd855-f2ac-43e6-842b-41e44cdbe1a9 admin admin] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:38:13.422807 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG oslo_concurrency.lockutils [None req-6f7dd855-f2ac-43e6-842b-41e44cdbe1a9 admin admin] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:38:13.423223 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG oslo_concurrency.lockutils [None req-6f7dd855-f2ac-43e6-842b-41e44cdbe1a9 admin admin] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:38:13.443210 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: INFO nova.api.openstack.requestlog [None req-6f7dd855-f2ac-43e6-842b-41e44cdbe1a9 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.079653 Aug 24 07:38:13.443740 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: [pid: 112129|app: 0|req: 37/72] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Aug 24 07:38:13 2022] GET /compute/v2.1/os-services => generated 791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 07:38:24.689453 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi [None req-58383e37-51df-4b74-8d3d-264be1ea1eec admin admin] Calling method '>' {{(pid=112128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:38:24.690477 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: INFO nova.api.openstack.requestlog [None req-58383e37-51df-4b74-8d3d-264be1ea1eec admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Aug 24 07:38:24.690913 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: [pid: 112128|app: 0|req: 36/73] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Aug 24 07:38:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:38:24.833967 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG dbcounter [-] [112129] Writing DB stats nova_cell0:SELECT=4 {{(pid=112129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:38:24.834680 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG dbcounter [-] [112129] Writing DB stats nova_cell1:SELECT=4 {{(pid=112129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:38:24.835306 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG dbcounter [-] [112129] Writing DB stats nova_api:SELECT=8 {{(pid=112129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:38:24.894436 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi [None req-c6cfe1f7-cb1c-4500-a514-8d09323b19d5 admin admin] Calling method '>' {{(pid=112129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:38:24.896862 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:38:24.896862 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: warnings.warn(msg) Aug 24 07:38:24.897974 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG oslo_concurrency.lockutils [None req-c6cfe1f7-cb1c-4500-a514-8d09323b19d5 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:38:24.898447 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG oslo_concurrency.lockutils [None req-c6cfe1f7-cb1c-4500-a514-8d09323b19d5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:38:24.898900 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG oslo_concurrency.lockutils [None req-c6cfe1f7-cb1c-4500-a514-8d09323b19d5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:38:24.899605 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG oslo_concurrency.lockutils [None req-c6cfe1f7-cb1c-4500-a514-8d09323b19d5 admin admin] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:38:24.900045 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG oslo_concurrency.lockutils [None req-c6cfe1f7-cb1c-4500-a514-8d09323b19d5 admin admin] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:38:24.900457 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG oslo_concurrency.lockutils [None req-c6cfe1f7-cb1c-4500-a514-8d09323b19d5 admin admin] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:38:24.924625 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: INFO nova.api.openstack.requestlog [None req-c6cfe1f7-cb1c-4500-a514-8d09323b19d5 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.095658 Aug 24 07:38:24.925167 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: [pid: 112129|app: 0|req: 38/74] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Aug 24 07:38:24 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:38:25.750290 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: DEBUG nova.api.openstack.wsgi [None req-58383e37-51df-4b74-8d3d-264be1ea1eec admin admin] Calling method '>' {{(pid=112128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:38:25.751332 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: INFO nova.api.openstack.requestlog [None req-58383e37-51df-4b74-8d3d-264be1ea1eec admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Aug 24 07:38:25.751733 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: [pid: 112128|app: 0|req: 37/75] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Aug 24 07:38:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:38:25.940146 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG nova.api.openstack.wsgi [None req-b65ab6d7-34fc-4bf7-ae6d-16e6a1fa3c55 admin admin] Calling method '>' {{(pid=112129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:38:25.942497 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 07:38:25.942497 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: warnings.warn(msg) Aug 24 07:38:25.943671 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG oslo_concurrency.lockutils [None req-b65ab6d7-34fc-4bf7-ae6d-16e6a1fa3c55 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:38:25.944132 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG oslo_concurrency.lockutils [None req-b65ab6d7-34fc-4bf7-ae6d-16e6a1fa3c55 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:38:25.944565 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG oslo_concurrency.lockutils [None req-b65ab6d7-34fc-4bf7-ae6d-16e6a1fa3c55 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:38:25.945281 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG oslo_concurrency.lockutils [None req-b65ab6d7-34fc-4bf7-ae6d-16e6a1fa3c55 admin admin] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:38:25.945728 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG oslo_concurrency.lockutils [None req-b65ab6d7-34fc-4bf7-ae6d-16e6a1fa3c55 admin admin] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:38:25.946149 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: DEBUG oslo_concurrency.lockutils [None req-b65ab6d7-34fc-4bf7-ae6d-16e6a1fa3c55 admin admin] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:38:25.967666 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: INFO nova.api.openstack.requestlog [None req-b65ab6d7-34fc-4bf7-ae6d-16e6a1fa3c55 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078629 Aug 24 07:38:25.968209 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: [pid: 112129|app: 0|req: 39/76] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Aug 24 07:38:25 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:39:21.028750 dv-cinder-854273-1-iscsi devstack@n-api.service[112127]: Wed Aug 24 07:39:21 2022 - graceful shutdown triggered... Aug 24 07:39:21.028881 dv-cinder-854273-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 24 07:39:21.029858 dv-cinder-854273-1-iscsi devstack@n-api.service[112129]: Gracefully killing worker 2 (pid: 112129)... Aug 24 07:39:21.030254 dv-cinder-854273-1-iscsi devstack@n-api.service[112128]: Gracefully killing worker 1 (pid: 112128)... Aug 24 07:39:22.030941 dv-cinder-854273-1-iscsi devstack@n-api.service[112127]: worker 1 buried after 1 seconds Aug 24 07:39:22.031467 dv-cinder-854273-1-iscsi devstack@n-api.service[112127]: worker 2 buried after 1 seconds Aug 24 07:39:22.031467 dv-cinder-854273-1-iscsi devstack@n-api.service[112127]: goodbye to uWSGI. Aug 24 07:39:22.032540 dv-cinder-854273-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 24 07:39:22.033085 dv-cinder-854273-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 24 07:39:22.035885 dv-cinder-854273-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 07:39:22.045447 dv-cinder-854273-1-iscsi devstack@n-api.service[127092]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 07:39:22.048625 dv-cinder-854273-1-iscsi devstack@n-api.service[127092]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 07:39:22 2022] *** Aug 24 07:39:22.048789 dv-cinder-854273-1-iscsi devstack@n-api.service[127092]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 07:39:22.048924 dv-cinder-854273-1-iscsi devstack@n-api.service[127092]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 07:39:22.049045 dv-cinder-854273-1-iscsi devstack@n-api.service[127092]: nodename: dv-cinder-854273-1-iscsi Aug 24 07:39:22.049156 dv-cinder-854273-1-iscsi devstack@n-api.service[127092]: machine: x86_64 Aug 24 07:39:22.049267 dv-cinder-854273-1-iscsi devstack@n-api.service[127092]: clock source: unix Aug 24 07:39:22.049375 dv-cinder-854273-1-iscsi devstack@n-api.service[127092]: pcre jit disabled Aug 24 07:39:22.049485 dv-cinder-854273-1-iscsi devstack@n-api.service[127092]: detected number of CPU cores: 4 Aug 24 07:39:22.049595 dv-cinder-854273-1-iscsi devstack@n-api.service[127092]: current working directory: / Aug 24 07:39:22.049716 dv-cinder-854273-1-iscsi devstack@n-api.service[127092]: detected binary path: /usr/bin/uwsgi-core Aug 24 07:39:22.049843 dv-cinder-854273-1-iscsi devstack@n-api.service[127092]: your processes number limit is 47680 Aug 24 07:39:22.049992 dv-cinder-854273-1-iscsi devstack@n-api.service[127092]: your memory page size is 4096 bytes Aug 24 07:39:22.050118 dv-cinder-854273-1-iscsi devstack@n-api.service[127092]: detected max file descriptor number: 2048 Aug 24 07:39:22.050232 dv-cinder-854273-1-iscsi devstack@n-api.service[127092]: lock engine: pthread robust mutexes Aug 24 07:39:22.050518 dv-cinder-854273-1-iscsi devstack@n-api.service[127092]: thunder lock: enabled Aug 24 07:39:22.050942 dv-cinder-854273-1-iscsi devstack@n-api.service[127092]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 07:39:22.051150 dv-cinder-854273-1-iscsi devstack@n-api.service[127092]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 07:39:22.091110 dv-cinder-854273-1-iscsi devstack@n-api.service[127092]: Python main interpreter initialized at 0x5579203609c0 Aug 24 07:39:22.091357 dv-cinder-854273-1-iscsi devstack@n-api.service[127092]: python threads support enabled Aug 24 07:39:22.091477 dv-cinder-854273-1-iscsi devstack@n-api.service[127092]: your server socket listen backlog is limited to 100 connections Aug 24 07:39:22.091579 dv-cinder-854273-1-iscsi devstack@n-api.service[127092]: your mercy for graceful operations on workers is 90 seconds Aug 24 07:39:22.091990 dv-cinder-854273-1-iscsi devstack@n-api.service[127092]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 07:39:22.092197 dv-cinder-854273-1-iscsi devstack@n-api.service[127092]: *** Operational MODE: preforking *** Aug 24 07:39:22.092598 dv-cinder-854273-1-iscsi devstack@n-api.service[127092]: *** uWSGI is running in multiple interpreter mode *** Aug 24 07:39:22.092717 dv-cinder-854273-1-iscsi devstack@n-api.service[127092]: spawned uWSGI master process (pid: 127092) Aug 24 07:39:22.093028 dv-cinder-854273-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 07:39:22.096346 dv-cinder-854273-1-iscsi devstack@n-api.service[127092]: spawned uWSGI worker 1 (pid: 127113, cores: 1) Aug 24 07:39:22.096346 dv-cinder-854273-1-iscsi devstack@n-api.service[127092]: spawned uWSGI worker 2 (pid: 127114, cores: 1) Aug 24 07:39:22.096346 dv-cinder-854273-1-iscsi devstack@n-api.service[127092]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 07:39:22.756142 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 07:39:22.760616 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 07:39:23.903792 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 07:39:23.903792 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: from cryptography.utils import int_from_bytes Aug 24 07:39:23.904426 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 07:39:23.904426 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: from cryptography.utils import int_from_bytes Aug 24 07:39:23.912167 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 07:39:23.912167 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: from cryptography.utils import int_from_bytes Aug 24 07:39:23.912656 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 07:39:23.912656 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: from cryptography.utils import int_from_bytes Aug 24 07:39:26.291497 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 07:39:26.292081 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 07:39:26.292367 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 07:39:26.292650 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 07:39:26.292903 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 07:39:26.293296 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.293624 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.293939 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.294256 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.294775 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.295093 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.295418 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.295740 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.296065 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.296324 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.296637 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.296958 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854273-1-iscsi {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.297376 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.297614 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.297879 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.298259 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.298533 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.298872 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.299195 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.299692 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.300990 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.300990 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.300990 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.301247 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.301365 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.301663 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.301990 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.302291 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.302901 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.303246 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.303619 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854273-1-iscsi {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.303951 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.304246 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.304558 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.304977 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.305284 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.305588 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.305903 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.306221 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.306525 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.306874 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.307190 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.307501 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.307815 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.308114 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.308417 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.308718 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.309031 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.309338 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.309665 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.309885 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.310224 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.310502 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.310844 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.311153 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.311399 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.311643 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.311957 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.312270 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.312572 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.312873 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.313172 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.313473 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.314306 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.314606 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.314930 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.315233 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.315545 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.315855 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.316172 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.316468 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.316779 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.317170 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.317417 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.317718 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.318054 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.318368 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.318671 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.319004 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.319319 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.319630 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.319949 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.320232 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.320546 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.320874 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.321173 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.321417 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 07:39:26.321835 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.321935 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 07:39:26.322021 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.322021 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.322202 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 07:39:26.322305 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.322547 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 07:39:26.322647 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.322830 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 07:39:26.322932 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.323184 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.323276 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.323480 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.323579 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.323782 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.323890 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.324083 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.324182 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.324383 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.324591 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.324693 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.324911 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.325012 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.325238 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.325338 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.325543 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.325634 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.325845 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.325946 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.326129 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.326226 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.326443 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.326542 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.326780 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.326877 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854273-1-iscsi {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.327085 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.327179 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.327386 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.327492 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.327686 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.327779 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.327990 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.328091 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.328299 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.328396 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.328599 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.328691 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.328902 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.328997 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.329242 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.329967 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.330082 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.330282 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.330388 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.330591 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.330702 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.330938 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.331042 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.331263 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.331356 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.331582 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.331738 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.331878 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.331983 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.332180 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.332280 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.332491 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.332632 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.332794 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.332886 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.333096 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.333190 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.333395 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.333488 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854273-1-iscsi {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.333697 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.333856 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.333992 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.334096 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.334292 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.334385 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.334589 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.335415 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.335598 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.335759 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.335907 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.336062 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.336224 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.336372 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.336529 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.336683 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.336834 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.337006 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.337166 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.337319 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.337472 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.337748 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.337926 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.338085 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.338243 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.338396 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.338548 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.338712 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.340191 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.340377 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.340535 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.340691 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.340854 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.340854 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.341086 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.341191 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.341286 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.341371 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.341462 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.341462 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.341682 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.341771 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.341854 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.341946 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.342030 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.342112 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.342213 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.342307 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.342397 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.342481 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.342571 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.342663 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.342837 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.342929 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.343013 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.343105 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.343191 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.343283 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.343368 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.343463 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.343549 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.343549 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.343549 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.343789 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.343922 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.344108 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.344212 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.344417 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.344509 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.344756 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.344873 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.345101 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.345246 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.345419 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.345522 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.345739 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.345838 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.346058 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.346160 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.346363 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.346463 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.346672 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.346844 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.347145 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.347292 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.347445 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.347547 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.347641 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.347848 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.347992 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.348119 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.348220 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.348464 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.348558 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.348785 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.348878 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.349094 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.349198 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.349402 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.349502 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.349710 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.349817 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.350021 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.350122 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.350332 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.350475 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.350640 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.350755 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.350989 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.351101 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.351334 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.351436 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.351639 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.351741 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.351889 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.351994 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.352194 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.352296 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.352502 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.352595 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.352813 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.352918 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.353114 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.353221 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.353417 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.353508 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.353712 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.353811 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.354012 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.354147 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.354318 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.354418 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.354623 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.354776 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.354958 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.355066 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.355265 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.355365 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.355567 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.355659 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.355873 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.355964 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.356178 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.356269 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.356480 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.356572 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.356784 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.356886 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.357090 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.357182 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.357394 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.357496 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.357703 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.357801 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.358007 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.358099 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.358310 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.358416 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.358617 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.358736 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.358945 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.359045 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.359248 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.359342 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.359560 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.359671 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.359871 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.359973 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.360180 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.360319 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.360508 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.360653 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.360821 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.360966 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.361127 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.361220 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.361442 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.361580 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.361745 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.361849 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.362045 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.362158 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.362351 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.362474 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.362669 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.362864 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.363008 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.363192 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.363307 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.363404 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.363599 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.363693 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.363903 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.363995 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.364207 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.364301 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.364506 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.364599 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.364807 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.364898 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.365105 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.365200 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.365402 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.365502 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.365699 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.365790 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.366000 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.366102 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.366300 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.366401 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.366610 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.366738 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.366923 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.367019 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.367245 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.367383 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:39:26.367561 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.367702 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.367853 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.367975 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.368157 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.368285 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.368445 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.368573 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.368787 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.368919 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.369090 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.369212 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.369430 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.369564 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.369765 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.369896 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.370088 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.370343 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.370512 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.370662 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.370972 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.371134 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.371283 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.371440 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.371606 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.371767 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.371917 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.372075 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.372224 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.372383 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.372544 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.372701 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.372834 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.372925 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.373017 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.373110 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.373206 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.373302 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.373396 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.373513 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.373710 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.373815 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.374020 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.374148 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.374338 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.374472 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.374642 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.374844 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.375092 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.375204 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.375428 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.375543 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.375764 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.375879 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.376602 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.376716 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.376936 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.377040 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.377251 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.377370 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.377563 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.377663 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.377870 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.377970 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.378178 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.378286 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.378486 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.378586 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.378813 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.378943 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.379146 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.379432 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.379545 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.379745 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.379845 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.380063 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.380175 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.380370 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.380469 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.380685 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.380792 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.380992 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.381103 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.381310 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.381417 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.381612 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.381720 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.381924 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.382033 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.382243 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.382452 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.382544 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.382650 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.383154 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.383266 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.383369 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.383452 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.383527 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.383598 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.383793 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.383938 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.384107 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.384435 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.384609 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.384775 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.384946 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.385094 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.385241 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.385396 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.385630 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.385793 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.385951 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.386107 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.386262 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.386437 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.386658 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.386879 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.387138 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.387313 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.387462 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.387611 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.387758 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.387922 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.388079 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.388227 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.388385 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.388541 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.388697 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.388855 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.389011 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.389165 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.389332 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.389489 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.389645 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.389804 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.389960 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.390127 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.390283 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.390431 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.390589 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.390756 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.390921 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.391078 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.391225 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.391400 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.391566 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.391716 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.392405 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.392765 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.392941 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.393412 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.393578 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.393728 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.393878 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.394122 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.394284 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.394444 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.394733 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.394904 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.395055 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.395213 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.395362 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.395518 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.395754 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.395917 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.396069 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.396232 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.396388 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.396559 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.396559 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.396942 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.397098 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.397350 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.397511 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.397740 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.397740 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.398023 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.398179 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.398334 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.398490 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.398660 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.398870 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.399040 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.399197 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.399197 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.399499 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.399663 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.399819 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.399983 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.400142 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.400291 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.400460 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.400608 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.400772 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.400772 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.401073 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.401073 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.401377 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.401533 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.401681 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.401856 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.403132 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.403638 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.403821 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.403984 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.404153 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.404386 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.404554 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.404739 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.404980 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.405134 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.405291 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.405448 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.405604 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.405783 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.406018 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.406180 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.406337 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.406497 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.406653 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.406914 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.407080 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.407239 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.407507 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.407672 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.407822 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.407969 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.408135 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.408284 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.408450 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.408608 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.408765 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.408913 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.409081 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.409238 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.409403 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.409552 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.409700 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.409847 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.409994 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.410158 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.410320 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.410469 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.410616 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.410616 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.411031 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.411198 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.411362 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.411510 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.411666 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.411813 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.411961 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.412117 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.412275 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.412438 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.412594 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.412750 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.412898 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.413073 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.413273 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.413752 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.413923 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.414073 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.414229 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.414409 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.414635 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.414810 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.414980 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.415212 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.415373 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.415536 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.415712 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.415868 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.416054 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.416285 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.416449 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.416606 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.416756 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.416923 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.417141 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.417305 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.417481 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.417703 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.417858 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.418019 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.418176 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.418332 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.418498 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.418648 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.418838 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.418999 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.419150 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.419312 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.419312 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.419601 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.419757 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.419914 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.420087 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.420255 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.420412 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.420567 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.420721 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.420874 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.421035 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.421205 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.421361 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.421523 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.421686 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.421841 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.422006 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.422170 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.422333 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.422496 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.422658 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.422840 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.423047 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.423253 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.423414 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.423587 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.424055 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.424217 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.424428 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.424617 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.424843 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.425012 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.425446 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.425618 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.425783 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.425947 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.426102 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.426276 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.426504 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.426663 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.426867 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.427033 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.427295 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.427745 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.427974 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.428141 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.428290 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.428446 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.428604 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.428763 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.428921 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.429085 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.429250 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.429399 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.429547 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.429706 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.429864 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.430026 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.430192 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.430354 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.430516 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.430671 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.430861 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.430861 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.431169 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.431323 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.431497 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.432223 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.432423 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.432626 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.432792 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.432956 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.433112 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.433311 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.433550 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.433708 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.434203 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.434380 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.434538 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.434758 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.435036 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.435199 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.435353 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.435596 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.435765 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.435931 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.436108 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.436264 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.436426 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.436677 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.436838 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.437010 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.437165 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.437419 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.437589 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.437753 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.437917 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.438177 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.438347 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.438504 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.439222 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.439373 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.439373 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.439672 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.439833 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.439982 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.440148 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.440307 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.440455 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.440616 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.440773 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.440921 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.441077 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.441233 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.441395 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.441544 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.441690 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.441845 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.442000 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.442170 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.442399 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.442565 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.442742 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.442896 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.443061 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.443212 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.443420 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.443581 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.443730 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.443885 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.444404 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.444585 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.444744 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.444893 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.445061 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.445293 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.445448 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.445629 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.445862 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.446022 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.446172 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.446335 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.446491 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.446666 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.446933 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.447086 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.447245 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.447423 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.447641 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.447793 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.447942 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.448106 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.448344 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.448513 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.448672 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.448672 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.448961 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.449120 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.449277 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.449434 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.449583 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.449745 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.449894 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.450041 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.450213 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.450363 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.450512 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.450660 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.450844 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.451001 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.451184 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.451350 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.451504 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.451658 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.451821 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.451986 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.452150 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.452312 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.452475 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.452638 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.453359 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.453577 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.453753 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.453909 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.454063 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.455116 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.455305 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.455548 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.455709 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.455883 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.456115 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.456115 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.456415 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.456585 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.456742 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.456929 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.457162 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.457321 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.457483 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.457672 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.457910 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.458079 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.458242 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.458508 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.458680 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.458863 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.459020 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.459184 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.459397 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.459397 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.459706 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.459871 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.460028 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.460028 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.460341 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.460341 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.460649 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.460649 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.460943 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.461098 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.461277 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.461991 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.462168 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.462333 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.462497 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.462654 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.462886 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.463058 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.463224 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.463386 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.463585 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.463748 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.463903 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.464080 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.464238 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.464411 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.464659 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.464827 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.465002 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.466000 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.466274 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.466445 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.466610 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.466787 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.466957 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.467140 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.467406 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.467567 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.467722 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.467896 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.468141 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.468301 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.468474 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.468720 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.468889 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.469054 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.469227 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.469393 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.469557 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.469724 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.469911 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.470077 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.470077 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.470398 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.470555 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.470738 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.470912 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.471083 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.471239 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.471410 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.471567 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.471740 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.471903 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.472074 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.472238 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.472430 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.472591 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.472754 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.472909 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.473078 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.473241 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.473396 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.473550 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.473746 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.473924 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.474095 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.474252 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.474413 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.474569 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.474865 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.475039 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.475207 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.475542 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.475789 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.475978 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.476240 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.476562 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.476738 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.476901 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.477065 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.477220 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.477402 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.477664 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.477953 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.478133 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.478337 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.478497 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.478652 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.478927 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.479089 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.479257 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.479411 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.479574 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.479736 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.479736 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.480042 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.480212 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.480368 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.480530 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.480699 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.480699 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.481003 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.481003 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.481316 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.481483 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.481648 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.481648 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.481951 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.482107 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.482260 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.482260 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.482576 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.482576 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.482911 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.483080 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.483247 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.483409 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.483575 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.483783 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.483952 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.484125 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.484294 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.484457 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.484612 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.484777 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.485017 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.485180 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.485345 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.485717 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.485961 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.486123 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.486384 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.486649 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.486845 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.487004 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.487198 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.487198 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.487506 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.487765 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.487945 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.488184 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.488364 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.488521 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.488675 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.488838 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.489098 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.489260 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.489417 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.489579 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.489734 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.489904 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.490066 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.490232 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.490390 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.490564 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.490759 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.490922 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.491086 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.491242 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.491397 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.491559 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.491724 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.491880 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.492042 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.492197 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.492360 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.492528 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.496269 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.496581 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.496858 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.497030 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.497211 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.497373 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.497544 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.497729 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.497979 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.498169 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.498414 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.498578 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.498791 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.498956 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.499136 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.499373 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.499543 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.499714 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.499871 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.500025 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.500199 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.500199 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.500514 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.500685 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.500842 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.501016 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.501723 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.501882 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.502036 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.502200 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.502364 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.502528 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.502683 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.502900 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.503068 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.503068 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.503365 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.503539 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.503703 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.503858 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.504025 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.504201 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.504978 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.505165 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.505395 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.505565 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.505804 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.505963 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.506148 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.506528 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.506839 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.507089 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.507252 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.507417 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.507581 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.507746 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.507902 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.508158 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.508321 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.508570 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.508737 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.508892 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.509067 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.509234 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.509408 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.509645 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.509808 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.509973 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.510146 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.510307 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.510469 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.510634 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.510876 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.511033 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.511033 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.511370 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.511525 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.511687 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.511842 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.512005 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.512171 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.512336 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.512492 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.512647 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.512801 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.512970 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.513142 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.513316 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.513472 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.513635 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.513790 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.513959 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.514116 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.514278 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.514442 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.514597 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.514804 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.515025 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.515025 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.515338 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.515593 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.515753 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.515916 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.516086 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.516241 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.517829 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.518008 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.518195 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.518440 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.518704 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.518885 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.519044 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.519219 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.519376 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.519550 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.519809 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.519979 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.520121 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.520226 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.520323 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.520441 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.520539 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.520539 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.520718 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.520813 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.520900 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.521000 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.521088 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.521173 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.521258 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.521343 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.521442 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.521537 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.521623 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.521623 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.521788 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.521874 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.521968 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.522055 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.522140 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.522231 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.522317 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.522403 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.522495 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.522582 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.522674 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.522812 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.522895 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.522969 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.523055 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.523130 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.523210 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.523283 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.523354 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.523435 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.523508 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.523587 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.523660 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.523739 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.523820 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.523906 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.523980 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.524060 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.524141 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.524215 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.524287 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.524371 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.524453 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.524533 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.524606 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.524678 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.524757 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.524840 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.524921 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.525005 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.525146 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.525222 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.525308 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.525391 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.525465 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.525563 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.525646 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.525719 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.525805 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.525886 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.525960 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.526039 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.526111 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.526190 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.526277 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.526359 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.526439 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.526743 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.526826 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.526900 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.526987 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.527063 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.527137 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.527218 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.527299 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.527382 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.527644 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.527737 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.527812 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.527914 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.527990 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.528071 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.528146 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.528226 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.528301 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.528546 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.528637 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.528747 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.528824 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.528897 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.528968 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.529039 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.529117 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.529201 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.529276 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.529348 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.529428 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.529508 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.529594 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.529594 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.529727 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.529727 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.530015 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.530090 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.530258 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.530337 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.530418 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.530492 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.530563 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.530634 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.530778 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.530871 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.530954 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.531029 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.531101 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.531173 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.531255 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.531350 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.531425 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.531497 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.531569 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.531651 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.531733 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.531806 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.531878 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.531949 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.532028 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.532028 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.532181 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.532255 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.532359 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.532446 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.532531 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.532608 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.532689 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.532771 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.532853 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.532937 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.533025 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.533102 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.533175 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.533254 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.533328 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.533400 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.533486 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.533568 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.533568 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.533568 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.533568 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.533857 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.533939 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.534020 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.534020 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.534020 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.534020 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.534020 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.534020 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.534414 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.534489 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.534560 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.534640 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.534750 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.534835 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.534914 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.534987 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.535057 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.535191 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.535280 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.535361 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.535442 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.535530 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.535604 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.535686 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.535760 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.535832 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.535902 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.535973 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.536044 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.536124 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.536198 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.536269 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.536360 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.536440 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.536523 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.536817 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.536913 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.536997 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.537077 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.537158 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.537245 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.537327 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.537407 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.537486 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.537559 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.537661 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.537917 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.537996 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.538068 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.538139 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.538210 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.538281 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.538367 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.538448 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.538548 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.538893 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.538981 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.539070 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.539152 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.539226 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.539297 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.539369 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.539439 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.539439 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.539597 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.539671 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.539741 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.539820 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.540066 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.540169 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.540255 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.540337 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.540413 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.540493 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.540573 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.540660 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.540734 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.540805 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.540885 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.540957 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.541038 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.541119 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.541192 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.541263 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.541334 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.541404 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.541485 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.541568 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.541649 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.541730 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.541810 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.541884 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.541965 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.542046 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.542127 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.542200 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.542271 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.542343 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.542428 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.542428 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.542559 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.542631 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.542755 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.542851 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.542928 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.543008 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.543081 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.543151 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.543229 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.543323 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.543406 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.543487 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.543561 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.543632 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.543710 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.543796 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.543869 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.543947 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.544027 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.544107 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.544188 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.544188 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.544330 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.544410 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.544483 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.544554 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.544633 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.544706 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.544777 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.544848 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.544953 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.545027 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.545113 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.545309 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.545400 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.545482 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.545556 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.545628 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.545782 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.545858 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.545931 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.546020 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.546092 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.546172 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.546254 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.546334 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.546407 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.546491 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.546566 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.546645 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.546762 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.547039 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.547116 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.547203 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.547280 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.547361 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.547435 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.547514 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.547594 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.547673 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.547753 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.547861 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.548625 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.548721 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.548721 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.548857 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.548857 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.548998 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.549070 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.549148 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.549228 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.549300 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.549543 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.549647 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.549730 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.549805 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.549884 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.549957 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.550199 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.550283 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.550363 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.550443 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.550516 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.550601 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.550676 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.550779 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.550852 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.550924 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.551008 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.551092 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.551174 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.551248 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.551329 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.551409 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.551483 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.551572 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.551654 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.551654 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.551785 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.551856 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.551943 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.551943 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.552082 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.552155 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.552227 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.553506 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 07:39:26.553627 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.553627 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.553627 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.553627 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.556144 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.556144 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.556144 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.556144 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.556144 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.556144 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.556144 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.556144 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.558250 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.558250 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.558250 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.558250 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.558250 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.558250 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.559342 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.559342 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.559342 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.559342 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.560303 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.560303 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.560303 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.560764 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.560918 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.561130 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.561437 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.561751 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.562076 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.562391 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.562775 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.563031 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.563349 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.563711 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.564521 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.564998 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.565322 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.565637 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.565943 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.566249 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.566555 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.566890 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.567272 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.567494 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.567806 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.568111 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.568418 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.568723 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.569029 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.569335 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.569753 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.570004 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.570381 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.570628 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.570966 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.571492 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.571812 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.572142 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.572471 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.572794 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.573110 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.573548 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.574377 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.575164 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.575495 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.575819 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.576142 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.576463 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.576799 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.577134 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.578382 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.578382 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.578928 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.579273 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.579607 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.579932 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.580268 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.580616 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.580892 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.581901 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.581901 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.582813 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.586484 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.586484 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.586484 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.586484 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.586484 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.586484 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.586484 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.586484 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.588453 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.588453 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.588453 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.588453 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.588453 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.588453 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.588453 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.591342 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.591342 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:39:26.591342 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 07:39:26.632128 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO dbcounter [None req-9d2178b9-8fd1-4365-8976-c4d89a51632e None None] Registered counter for database nova_api Aug 24 07:39:26.651377 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO dbcounter [None req-9d21af2b-5be7-4e5a-b866-d81fb72e2d1a None None] Registered counter for database nova_api Aug 24 07:39:26.652510 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_db.sqlalchemy.engines [None req-9d2178b9-8fd1-4365-8976-c4d89a51632e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127114) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:39:26.659152 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writer thread running {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:39:26.671278 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_db.sqlalchemy.engines [None req-9d21af2b-5be7-4e5a-b866-d81fb72e2d1a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127113) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:39:26.679102 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writer thread running {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:39:26.717616 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.context [None req-9d2178b9-8fd1-4365-8976-c4d89a51632e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),25bce80b-e624-439b-a839-ab618d931874(cell1) {{(pid=127114) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 07:39:26.722194 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9d2178b9-8fd1-4365-8976-c4d89a51632e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:39:26.722675 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9d2178b9-8fd1-4365-8976-c4d89a51632e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:39:26.724251 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9d2178b9-8fd1-4365-8976-c4d89a51632e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:39:26.725015 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9d2178b9-8fd1-4365-8976-c4d89a51632e None None] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:39:26.725460 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9d2178b9-8fd1-4365-8976-c4d89a51632e None None] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:39:26.727468 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9d2178b9-8fd1-4365-8976-c4d89a51632e None None] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:39:26.729439 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO dbcounter [None req-9d2178b9-8fd1-4365-8976-c4d89a51632e None None] Registered counter for database nova_cell0 Aug 24 07:39:26.733655 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO dbcounter [None req-9d2178b9-8fd1-4365-8976-c4d89a51632e None None] Registered counter for database nova_cell1 Aug 24 07:39:26.736577 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.context [None req-9d21af2b-5be7-4e5a-b866-d81fb72e2d1a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),25bce80b-e624-439b-a839-ab618d931874(cell1) {{(pid=127113) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 07:39:26.740732 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9d21af2b-5be7-4e5a-b866-d81fb72e2d1a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:39:26.741098 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_db.sqlalchemy.engines [None req-9d2178b9-8fd1-4365-8976-c4d89a51632e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127114) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:39:26.741227 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9d21af2b-5be7-4e5a-b866-d81fb72e2d1a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:39:26.742827 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9d21af2b-5be7-4e5a-b866-d81fb72e2d1a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:39:26.743273 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_db.sqlalchemy.engines [None req-9d2178b9-8fd1-4365-8976-c4d89a51632e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127114) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:39:26.743595 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9d21af2b-5be7-4e5a-b866-d81fb72e2d1a None None] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:39:26.744047 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9d21af2b-5be7-4e5a-b866-d81fb72e2d1a None None] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:39:26.746045 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9d21af2b-5be7-4e5a-b866-d81fb72e2d1a None None] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:39:26.748090 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO dbcounter [None req-9d21af2b-5be7-4e5a-b866-d81fb72e2d1a None None] Registered counter for database nova_cell0 Aug 24 07:39:26.748265 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writer thread running {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:39:26.751013 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writer thread running {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:39:26.752175 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO dbcounter [None req-9d21af2b-5be7-4e5a-b866-d81fb72e2d1a None None] Registered counter for database nova_cell1 Aug 24 07:39:26.759289 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_db.sqlalchemy.engines [None req-9d21af2b-5be7-4e5a-b866-d81fb72e2d1a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127113) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:39:26.761487 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_db.sqlalchemy.engines [None req-9d21af2b-5be7-4e5a-b866-d81fb72e2d1a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127113) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:39:26.766560 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writer thread running {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:39:26.769802 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writer thread running {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:39:26.901272 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO dbcounter [None req-9d2178b9-8fd1-4365-8976-c4d89a51632e None None] Registered counter for database nova_cell0 Aug 24 07:39:26.908763 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_db.sqlalchemy.engines [None req-9d2178b9-8fd1-4365-8976-c4d89a51632e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127114) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:39:26.913211 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writer thread running {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:39:26.923685 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO dbcounter [None req-9d21af2b-5be7-4e5a-b866-d81fb72e2d1a None None] Registered counter for database nova_cell0 Aug 24 07:39:26.933046 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_db.sqlalchemy.engines [None req-9d21af2b-5be7-4e5a-b866-d81fb72e2d1a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127113) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:39:26.937426 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writer thread running {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:39:27.240902 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: WARNING keystonemiddleware.auth_token [None req-9d2178b9-8fd1-4365-8976-c4d89a51632e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 07:39:27.248265 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: WARNING keystonemiddleware.auth_token [None req-9d2178b9-8fd1-4365-8976-c4d89a51632e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 07:39:27.264434 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: WARNING keystonemiddleware.auth_token [None req-9d21af2b-5be7-4e5a-b866-d81fb72e2d1a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 07:39:27.272374 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: WARNING keystonemiddleware.auth_token [None req-9d21af2b-5be7-4e5a-b866-d81fb72e2d1a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 07:39:27.603357 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: WARNING keystonemiddleware.auth_token [None req-9d2178b9-8fd1-4365-8976-c4d89a51632e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 07:39:27.609445 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: WARNING keystonemiddleware.auth_token [None req-9d2178b9-8fd1-4365-8976-c4d89a51632e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 07:39:27.614913 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5579203609c0 pid: 127114 (default app) Aug 24 07:39:27.620169 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: WARNING keystonemiddleware.auth_token [None req-9d21af2b-5be7-4e5a-b866-d81fb72e2d1a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 07:39:27.626241 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: WARNING keystonemiddleware.auth_token [None req-9d21af2b-5be7-4e5a-b866-d81fb72e2d1a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 07:39:27.631627 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5579203609c0 pid: 127113 (default app) Aug 24 07:40:02.708960 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_api:SELECT=3 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:40:02.712266 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell1:SELECT=3 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:40:02.713481 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell0:SELECT=3 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:40:02.716576 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell0:SELECT=3 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:40:03.166173 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_api:SELECT=3 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:40:03.168830 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell1:SELECT=3 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:40:03.173373 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell0:SELECT=3 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:40:03.176138 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell0:SELECT=3 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:40:04.159262 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-3edfe79f-838f-4ab2-9be1-137cb2642f92 tempest-VolumesSnapshotsTestJSON-656432460 tempest-VolumesSnapshotsTestJSON-656432460-project] Action: 'create', calling method: .version_select at 0x7faf69cfb700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1463841253"}} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:40:04.496625 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-05fa180d-18b2-4b81-be65-6d5dac250673 tempest-VolumesGetTestJSON-2058916000 tempest-VolumesGetTestJSON-2058916000-project] Action: 'create', calling method: .version_select at 0x7faf69cfa5e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1094107672", "metadata": {"Type": "work"}}} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:40:06.019709 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-05fa180d-18b2-4b81-be65-6d5dac250673 tempest-VolumesGetTestJSON-2058916000 tempest-VolumesGetTestJSON-2058916000-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.871917 Aug 24 07:40:06.024337 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-3edfe79f-838f-4ab2-9be1-137cb2642f92 tempest-VolumesSnapshotsTestJSON-656432460 tempest-VolumesSnapshotsTestJSON-656432460-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.333833 Aug 24 07:40:06.033480 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 1/1] 10.222.0.42 () {60 vars in 1155 bytes} [Wed Aug 24 07:40:02 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3346 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 07:40:06.036364 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 1/2] 10.222.0.42 () {60 vars in 1156 bytes} [Wed Aug 24 07:40:03 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2896 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 07:40:06.038962 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-d707826f-df9f-4b76-b3b1-ce223ad08a90 tempest-VolumesTestJSON-1106249829 tempest-VolumesTestJSON-1106249829-project] Calling method '.version_select at 0x7faf69bd1550>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:06.042985 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-136c3bbe-43f3-42bf-be19-cddd1d9bafa0 tempest-VolumesSnapshotsTestJSON-656432460 tempest-VolumesSnapshotsTestJSON-656432460-project] Calling method '.version_select at 0x7faf69bd0550>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:06.189948 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-136c3bbe-43f3-42bf-be19-cddd1d9bafa0 tempest-VolumesSnapshotsTestJSON-656432460 tempest-VolumesSnapshotsTestJSON-656432460-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/2015ac70-45e6-455c-80e9-2470080cc44a" status: 200 len: 346 microversion: 2.1 time: 0.151513 Aug 24 07:40:06.190626 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 2/3] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Aug 24 07:40:06 2022] GET /compute/v2.1/os-volumes/2015ac70-45e6-455c-80e9-2470080cc44a => generated 346 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:40:06.198567 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-6cf9b238-b5d8-4c18-a11b-f91ada9df61f tempest-VolumesGetTestJSON-2058916000 tempest-VolumesGetTestJSON-2058916000-project] Calling method '.version_select at 0x7faf69bd0ca0>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:06.297227 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-d707826f-df9f-4b76-b3b1-ce223ad08a90 tempest-VolumesTestJSON-1106249829 tempest-VolumesTestJSON-1106249829-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/95f58893-22fc-4329-8a63-6f75b5c5c95a" status: 200 len: 351 microversion: 2.1 time: 0.261759 Aug 24 07:40:06.298273 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 2/4] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Aug 24 07:40:06 2022] GET /compute/v2.1/os-volumes/95f58893-22fc-4329-8a63-6f75b5c5c95a => generated 351 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:40:06.312915 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-e9160624-03e8-4d68-a415-da24a3d34820 tempest-VolumesSnapshotsTestJSON-656432460 tempest-VolumesSnapshotsTestJSON-656432460-project] Action: 'create', calling method: .version_select at 0x7faf69bd1c10>, body: {"snapshot": {"volume_id": "2015ac70-45e6-455c-80e9-2470080cc44a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1611379860"}} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:40:06.355891 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-6cf9b238-b5d8-4c18-a11b-f91ada9df61f tempest-VolumesGetTestJSON-2058916000 tempest-VolumesGetTestJSON-2058916000-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/406d9d4e-cb8c-4bb1-8c9e-c55b126c9ba1" status: 200 len: 354 microversion: 2.1 time: 0.163966 Aug 24 07:40:06.364977 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 3/5] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Aug 24 07:40:06 2022] GET /compute/v2.1/os-volumes/406d9d4e-cb8c-4bb1-8c9e-c55b126c9ba1 => generated 354 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:40:06.370506 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-d9d8bdb8-ac0b-492f-abbf-49a3ad44d9cc tempest-VolumesGetTestJSON-2058916000 tempest-VolumesGetTestJSON-2058916000-project] Calling method '.version_select at 0x7faf69be03a0>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:07.139223 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-e9160624-03e8-4d68-a415-da24a3d34820 tempest-VolumesSnapshotsTestJSON-656432460 tempest-VolumesSnapshotsTestJSON-656432460-project] 10.222.0.42 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.830782 Aug 24 07:40:07.139804 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 3/6] 10.222.0.42 () {60 vars in 1162 bytes} [Wed Aug 24 07:40:06 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:40:07.149992 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-be86479e-65ef-4ba2-b36d-2f8327d25492 tempest-VolumesSnapshotsTestJSON-656432460 tempest-VolumesSnapshotsTestJSON-656432460-project] Calling method '.version_select at 0x7faf69be4d30>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:07.173443 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-d9d8bdb8-ac0b-492f-abbf-49a3ad44d9cc tempest-VolumesGetTestJSON-2058916000 tempest-VolumesGetTestJSON-2058916000-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/406d9d4e-cb8c-4bb1-8c9e-c55b126c9ba1" status: 200 len: 354 microversion: 2.1 time: 0.806178 Aug 24 07:40:07.186624 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 4/7] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Aug 24 07:40:06 2022] GET /compute/v2.1/os-volumes/406d9d4e-cb8c-4bb1-8c9e-c55b126c9ba1 => generated 354 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:40:07.198196 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-bfe8887f-38e4-4af9-9df6-bb6913ae6f00 tempest-VolumesGetTestJSON-2058916000 tempest-VolumesGetTestJSON-2058916000-project] Calling method '.version_select at 0x7faf69bd0c10>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:07.437233 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-be86479e-65ef-4ba2-b36d-2f8327d25492 tempest-VolumesSnapshotsTestJSON-656432460 tempest-VolumesSnapshotsTestJSON-656432460-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/8cb88373-3d1e-499e-aa39-bbbbb3f5dea3" status: 200 len: 287 microversion: 2.1 time: 0.289768 Aug 24 07:40:07.437233 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 4/8] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Aug 24 07:40:07 2022] GET /compute/v2.1/os-snapshots/8cb88373-3d1e-499e-aa39-bbbbb3f5dea3 => generated 287 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:40:07.442498 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-7262f6a2-5d4b-40ff-9047-53e15bf0fcb3 tempest-VolumesTestJSON-1106249829 tempest-VolumesTestJSON-1106249829-project] Calling method '.version_select at 0x7faf69be4430>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:07.479501 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-bfe8887f-38e4-4af9-9df6-bb6913ae6f00 tempest-VolumesGetTestJSON-2058916000 tempest-VolumesGetTestJSON-2058916000-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/406d9d4e-cb8c-4bb1-8c9e-c55b126c9ba1" status: 202 len: 0 microversion: 2.1 time: 0.287087 Aug 24 07:40:07.480142 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 5/9] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Aug 24 07:40:07 2022] DELETE /compute/v2.1/os-volumes/406d9d4e-cb8c-4bb1-8c9e-c55b126c9ba1 => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 07:40:07.486046 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-ccfbc126-45ce-47c3-a6ef-a2247a9d2a6e tempest-VolumesSnapshotsTestJSON-656432460 tempest-VolumesSnapshotsTestJSON-656432460-project] Calling method '.version_select at 0x7faf69bd0550>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:07.657481 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-7262f6a2-5d4b-40ff-9047-53e15bf0fcb3 tempest-VolumesTestJSON-1106249829 tempest-VolumesTestJSON-1106249829-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/7101703d-3e0a-479c-90e9-09f772c78a24" status: 200 len: 351 microversion: 2.1 time: 0.218707 Aug 24 07:40:07.658623 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 5/10] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Aug 24 07:40:07 2022] GET /compute/v2.1/os-volumes/7101703d-3e0a-479c-90e9-09f772c78a24 => generated 351 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:40:07.705241 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-5f31a46e-1cc3-44a4-8c44-a5c6dbb50674 tempest-VolumesGetTestJSON-2058916000 tempest-VolumesGetTestJSON-2058916000-project] Calling method '.version_select at 0x7faf6a5a88b0>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:07.736566 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-ccfbc126-45ce-47c3-a6ef-a2247a9d2a6e tempest-VolumesSnapshotsTestJSON-656432460 tempest-VolumesSnapshotsTestJSON-656432460-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.255077 Aug 24 07:40:07.738805 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 6/11] 10.222.0.42 () {58 vars in 1140 bytes} [Wed Aug 24 07:40:07 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:40:07.759071 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-b578646d-af6f-4f11-ab48-85c7d4274aea tempest-VolumesSnapshotsTestJSON-656432460 tempest-VolumesSnapshotsTestJSON-656432460-project] Calling method '.version_select at 0x7faf69be0dc0>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:07.891563 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-5f31a46e-1cc3-44a4-8c44-a5c6dbb50674 tempest-VolumesGetTestJSON-2058916000 tempest-VolumesGetTestJSON-2058916000-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/406d9d4e-cb8c-4bb1-8c9e-c55b126c9ba1" status: 200 len: 353 microversion: 2.1 time: 0.231001 Aug 24 07:40:07.892142 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 6/12] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Aug 24 07:40:07 2022] GET /compute/v2.1/os-volumes/406d9d4e-cb8c-4bb1-8c9e-c55b126c9ba1 => generated 353 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:40:08.003539 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-b578646d-af6f-4f11-ab48-85c7d4274aea tempest-VolumesSnapshotsTestJSON-656432460 tempest-VolumesSnapshotsTestJSON-656432460-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/8cb88373-3d1e-499e-aa39-bbbbb3f5dea3" status: 200 len: 287 microversion: 2.1 time: 0.255046 Aug 24 07:40:08.004378 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 7/13] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Aug 24 07:40:07 2022] GET /compute/v2.1/os-snapshots/8cb88373-3d1e-499e-aa39-bbbbb3f5dea3 => generated 287 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:40:08.905881 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-b916f68f-1cf6-4f55-a04e-b5bd52a7f159 tempest-VolumesGetTestJSON-2058916000 tempest-VolumesGetTestJSON-2058916000-project] Calling method '.version_select at 0x7faf69bd1c10>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:09.016944 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-ff912c68-172b-46ff-a3bd-956cb9c192d7 tempest-VolumesSnapshotsTestJSON-656432460 tempest-VolumesSnapshotsTestJSON-656432460-project] Calling method '.version_select at 0x7faf69be0af0>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:09.062994 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-b916f68f-1cf6-4f55-a04e-b5bd52a7f159 tempest-VolumesGetTestJSON-2058916000 tempest-VolumesGetTestJSON-2058916000-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/406d9d4e-cb8c-4bb1-8c9e-c55b126c9ba1" status: 200 len: 353 microversion: 2.1 time: 0.161407 Aug 24 07:40:09.063959 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 7/14] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Aug 24 07:40:08 2022] GET /compute/v2.1/os-volumes/406d9d4e-cb8c-4bb1-8c9e-c55b126c9ba1 => generated 353 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:40:09.167039 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-ff912c68-172b-46ff-a3bd-956cb9c192d7 tempest-VolumesSnapshotsTestJSON-656432460 tempest-VolumesSnapshotsTestJSON-656432460-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/8cb88373-3d1e-499e-aa39-bbbbb3f5dea3" status: 200 len: 287 microversion: 2.1 time: 0.153409 Aug 24 07:40:09.167619 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 8/15] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Aug 24 07:40:09 2022] GET /compute/v2.1/os-snapshots/8cb88373-3d1e-499e-aa39-bbbbb3f5dea3 => generated 287 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:40:10.076829 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-7a0ec340-5287-4971-83ed-f32276100253 tempest-VolumesGetTestJSON-2058916000 tempest-VolumesGetTestJSON-2058916000-project] Calling method '.version_select at 0x7faf69be4a60>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:10.180549 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-5cad1069-1aa8-4cb2-8f7a-cc854957719b tempest-VolumesSnapshotsTestJSON-656432460 tempest-VolumesSnapshotsTestJSON-656432460-project] Calling method '.version_select at 0x7faf69be0280>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:10.224547 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-7a0ec340-5287-4971-83ed-f32276100253 tempest-VolumesGetTestJSON-2058916000 tempest-VolumesGetTestJSON-2058916000-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/406d9d4e-cb8c-4bb1-8c9e-c55b126c9ba1" status: 200 len: 353 microversion: 2.1 time: 0.151412 Aug 24 07:40:10.225428 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 8/16] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Aug 24 07:40:10 2022] GET /compute/v2.1/os-volumes/406d9d4e-cb8c-4bb1-8c9e-c55b126c9ba1 => generated 353 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:40:10.283608 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-5cad1069-1aa8-4cb2-8f7a-cc854957719b tempest-VolumesSnapshotsTestJSON-656432460 tempest-VolumesSnapshotsTestJSON-656432460-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/8cb88373-3d1e-499e-aa39-bbbbb3f5dea3" status: 200 len: 287 microversion: 2.1 time: 0.105672 Aug 24 07:40:10.285585 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 9/17] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Aug 24 07:40:10 2022] GET /compute/v2.1/os-snapshots/8cb88373-3d1e-499e-aa39-bbbbb3f5dea3 => generated 287 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:40:10.841272 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-dcb89f8a-fbfd-45d4-8937-f62b14d15f06 tempest-VolumesTestJSON-1106249829 tempest-VolumesTestJSON-1106249829-project] Calling method '.version_select at 0x7faf69be4430>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:10.969861 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-dcb89f8a-fbfd-45d4-8937-f62b14d15f06 tempest-VolumesTestJSON-1106249829 tempest-VolumesTestJSON-1106249829-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/a9f35831-2e3e-4281-85ee-b4dbdbef42a5" status: 200 len: 350 microversion: 2.1 time: 0.134022 Aug 24 07:40:10.970732 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 9/18] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Aug 24 07:40:10 2022] GET /compute/v2.1/os-volumes/a9f35831-2e3e-4281-85ee-b4dbdbef42a5 => generated 350 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:40:10.990634 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-005eb590-0bcb-4f2d-b4b0-0df2e63bba4a tempest-VolumesTestJSON-1106249829 tempest-VolumesTestJSON-1106249829-project] Calling method '.version_select at 0x7faf69bd03a0>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:11.238953 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-be7881ce-a56e-4a54-8888-db48dbc63d95 tempest-VolumesGetTestJSON-2058916000 tempest-VolumesGetTestJSON-2058916000-project] Calling method '.version_select at 0x7faf69bd19d0>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:11.256754 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-005eb590-0bcb-4f2d-b4b0-0df2e63bba4a tempest-VolumesTestJSON-1106249829 tempest-VolumesTestJSON-1106249829-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.276875 Aug 24 07:40:11.258873 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 10/19] 10.222.0.42 () {58 vars in 1134 bytes} [Wed Aug 24 07:40:10 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:40:11.274825 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-dbad41a2-e741-4ed1-ba19-ad04e14ba410 tempest-VolumesTestJSON-1106249829 tempest-VolumesTestJSON-1106249829-project] Calling method '.version_select at 0x7faf69bd0820>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:11.304071 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.wsgi [None req-be7881ce-a56e-4a54-8888-db48dbc63d95 tempest-VolumesGetTestJSON-2058916000 tempest-VolumesGetTestJSON-2058916000-project] HTTP exception thrown: Volume 406d9d4e-cb8c-4bb1-8c9e-c55b126c9ba1 could not be found. Aug 24 07:40:11.308900 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-be7881ce-a56e-4a54-8888-db48dbc63d95 tempest-VolumesGetTestJSON-2058916000 tempest-VolumesGetTestJSON-2058916000-project] Request method failure captured: Aug 24 07:40:11.308900 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: request: GET /compute/v2.1/os-volumes/406d9d4e-cb8c-4bb1-8c9e-c55b126c9ba1 HTTP/1.1 Aug 24 07:40:11.308900 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept: application/json Aug 24 07:40:11.308900 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept-Encoding: identity Aug 24 07:40:11.308900 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Connection: close Aug 24 07:40:11.308900 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Length: 0 Aug 24 07:40:11.308900 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Type: application/json Aug 24 07:40:11.308900 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Host: 10.222.0.42 Aug 24 07:40:11.308900 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Openstack-System-Scope: None Aug 24 07:40:11.308900 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: User-Agent: python-urllib3/1.26.11 Aug 24 07:40:11.308900 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Auth-Token: gAAAAABjBdXTwLw4rCnj_zTOzlJX7jhRRcdNZfJuxaRC5fosFquOgXv3Pa4iBLMqstXVdZvY2o2IkHHyFLIkckxJ7VUeKhf1ixT7OymaBU5_GXcFTCN6MqboahHghjRyI7UUaUrM6NJ0FOnsw5B8ICDe8Kw9xiIdRQRD6c6Nc9aGkHQ8FCj0Q3c Aug 24 07:40:11.308900 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Id: None Aug 24 07:40:11.308900 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Name: None Aug 24 07:40:11.308900 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Identity-Status: Confirmed Aug 24 07:40:11.308900 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Is-Admin-Project: True Aug 24 07:40:11.308900 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Id: default Aug 24 07:40:11.308900 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Name: Default Aug 24 07:40:11.308900 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Id: 7d34a03db7bc4ceca0ba091c71ed9719 Aug 24 07:40:11.308900 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Name: tempest-VolumesGetTestJSON-2058916000 Aug 24 07:40:11.308900 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Role: reader,member Aug 24 07:40:11.308900 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Roles: reader,member Aug 24 07:40:11.309935 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7d34a03db7bc4ceca0ba091c71ed9719"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7d34a03db7bc4ceca0ba091c71ed9719", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7d34a03db7bc4ceca0ba091c71ed9719"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7d34a03db7bc4ceca0ba091c71ed9719"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:40:11.309935 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant: tempest-VolumesGetTestJSON-2058916000 Aug 24 07:40:11.309935 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Id: 7d34a03db7bc4ceca0ba091c71ed9719 Aug 24 07:40:11.309935 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Name: tempest-VolumesGetTestJSON-2058916000 Aug 24 07:40:11.309935 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User: tempest-VolumesGetTestJSON-2058916000-project Aug 24 07:40:11.309935 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Id: default Aug 24 07:40:11.309935 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Name: Default Aug 24 07:40:11.309935 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Id: a9ecbdaf05134e92890b15f551eca632 Aug 24 07:40:11.309935 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Name: tempest-VolumesGetTestJSON-2058916000-project Aug 24 07:40:11.309935 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: method: Aug 24 07:40:11.309935 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: exception: Volume 406d9d4e-cb8c-4bb1-8c9e-c55b126c9ba1 could not be found. Aug 24 07:40:11.309935 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: action_args: {'id': '406d9d4e-cb8c-4bb1-8c9e-c55b126c9ba1'} Aug 24 07:40:11.309935 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:40:11.310747 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:40:11.310747 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 07:40:11.310747 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 07:40:11.310747 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 07:40:11.310747 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 07:40:11.310747 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 07:40:11.310747 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 07:40:11.310747 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 07:40:11.310747 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 07:40:11.310747 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 07:40:11.310747 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 07:40:11.310747 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 07:40:11.310747 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 07:40:11.310747 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 07:40:11.310747 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 07:40:11.310747 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 406d9d4e-cb8c-4bb1-8c9e-c55b126c9ba1 could not be found. (HTTP 404) (Request-ID: req-76ade3de-a6e4-44d4-97a7-edb547050bae) Aug 24 07:40:11.310747 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:40:11.310747 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:40:11.310747 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:40:11.316063 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:40:11.316063 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 07:40:11.316063 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 07:40:11.316063 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 07:40:11.316063 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 07:40:11.316063 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 07:40:11.316063 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 07:40:11.316063 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 07:40:11.316063 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 07:40:11.316063 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 07:40:11.316063 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 07:40:11.316063 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 07:40:11.316063 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 07:40:11.316063 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 07:40:11.316063 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 07:40:11.316063 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 07:40:11.316063 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 07:40:11.316063 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 07:40:11.316063 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 07:40:11.317110 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 07:40:11.317110 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 07:40:11.317110 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 07:40:11.317110 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 07:40:11.317110 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 406d9d4e-cb8c-4bb1-8c9e-c55b126c9ba1 could not be found. Aug 24 07:40:11.317110 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:40:11.317110 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:40:11.317110 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:40:11.317110 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:40:11.317110 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:40:11.317110 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:40:11.317110 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:40:11.317110 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:40:11.317110 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 07:40:11.317110 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 07:40:11.317110 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:40:11.317110 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:40:11.317110 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 07:40:11.317110 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:40:11.318032 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 406d9d4e-cb8c-4bb1-8c9e-c55b126c9ba1 could not be found. Aug 24 07:40:11.318032 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:40:11.318032 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:40:11.318032 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:40:11.318032 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:40:11.318032 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:40:11.318032 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:40:11.318032 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:40:11.318032 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:40:11.318032 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 406d9d4e-cb8c-4bb1-8c9e-c55b126c9ba1 could not be found. Aug 24 07:40:11.318032 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:40:11.318032 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-be7881ce-a56e-4a54-8888-db48dbc63d95 tempest-VolumesGetTestJSON-2058916000 tempest-VolumesGetTestJSON-2058916000-project] Returning 404 to user: Volume 406d9d4e-cb8c-4bb1-8c9e-c55b126c9ba1 could not be found. {{(pid=127114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:40:11.318032 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-be7881ce-a56e-4a54-8888-db48dbc63d95 tempest-VolumesGetTestJSON-2058916000 tempest-VolumesGetTestJSON-2058916000-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/406d9d4e-cb8c-4bb1-8c9e-c55b126c9ba1" status: 404 len: 109 microversion: 2.1 time: 0.076389 Aug 24 07:40:11.318032 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 10/20] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Aug 24 07:40:11 2022] GET /compute/v2.1/os-volumes/406d9d4e-cb8c-4bb1-8c9e-c55b126c9ba1 => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:40:11.320388 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-bcb7784d-374f-4208-9f43-86b7907c1dfe tempest-VolumesSnapshotsTestJSON-656432460 tempest-VolumesSnapshotsTestJSON-656432460-project] Calling method '.version_select at 0x7faf69be48b0>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:11.427042 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-dbad41a2-e741-4ed1-ba19-ad04e14ba410 tempest-VolumesTestJSON-1106249829 tempest-VolumesTestJSON-1106249829-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.157845 Aug 24 07:40:11.437016 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 11/21] 10.222.0.42 () {58 vars in 1149 bytes} [Wed Aug 24 07:40:11 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:40:11.443880 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-4cf2c539-43d6-47fe-b75d-7e28976a9a44 tempest-VolumesTestJSON-1106249829 tempest-VolumesTestJSON-1106249829-project] Calling method '.version_select at 0x7faf69be01f0>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:11.496761 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-bcb7784d-374f-4208-9f43-86b7907c1dfe tempest-VolumesSnapshotsTestJSON-656432460 tempest-VolumesSnapshotsTestJSON-656432460-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/8cb88373-3d1e-499e-aa39-bbbbb3f5dea3" status: 200 len: 288 microversion: 2.1 time: 0.184503 Aug 24 07:40:11.497318 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 11/22] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Aug 24 07:40:11 2022] GET /compute/v2.1/os-snapshots/8cb88373-3d1e-499e-aa39-bbbbb3f5dea3 => generated 288 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:40:11.508265 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-a834c101-cda0-4360-8c5d-5d63845954dc tempest-VolumesSnapshotsTestJSON-656432460 tempest-VolumesSnapshotsTestJSON-656432460-project] Calling method '.version_select at 0x7faf69b55670>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:11.773291 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-4cf2c539-43d6-47fe-b75d-7e28976a9a44 tempest-VolumesTestJSON-1106249829 tempest-VolumesTestJSON-1106249829-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.335122 Aug 24 07:40:11.773850 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 12/23] 10.222.0.42 () {58 vars in 1134 bytes} [Wed Aug 24 07:40:11 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:40:11.786980 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-5eec9626-e7e5-4424-8724-28bc6d195591 tempest-VolumesTestJSON-1106249829 tempest-VolumesTestJSON-1106249829-project] Calling method '.version_select at 0x7faf69bf6a60>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:11.895625 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-a834c101-cda0-4360-8c5d-5d63845954dc tempest-VolumesSnapshotsTestJSON-656432460 tempest-VolumesSnapshotsTestJSON-656432460-project] 10.222.0.42 "DELETE /compute/v2.1/os-snapshots/8cb88373-3d1e-499e-aa39-bbbbb3f5dea3" status: 202 len: 0 microversion: 2.1 time: 0.391198 Aug 24 07:40:11.899953 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 12/24] 10.222.0.42 () {58 vars in 1254 bytes} [Wed Aug 24 07:40:11 2022] DELETE /compute/v2.1/os-snapshots/8cb88373-3d1e-499e-aa39-bbbbb3f5dea3 => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 07:40:11.905303 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-3e68187b-e0bc-481f-a154-408d6d37d4b0 tempest-VolumesSnapshotsTestJSON-656432460 tempest-VolumesSnapshotsTestJSON-656432460-project] Calling method '.version_select at 0x7faf6a5a8b80>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:12.099564 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.wsgi [None req-3e68187b-e0bc-481f-a154-408d6d37d4b0 tempest-VolumesSnapshotsTestJSON-656432460 tempest-VolumesSnapshotsTestJSON-656432460-project] HTTP exception thrown: Snapshot 8cb88373-3d1e-499e-aa39-bbbbb3f5dea3 could not be found. Aug 24 07:40:12.102938 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-3e68187b-e0bc-481f-a154-408d6d37d4b0 tempest-VolumesSnapshotsTestJSON-656432460 tempest-VolumesSnapshotsTestJSON-656432460-project] Request method failure captured: Aug 24 07:40:12.102938 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: request: GET /compute/v2.1/os-snapshots/8cb88373-3d1e-499e-aa39-bbbbb3f5dea3 HTTP/1.1 Aug 24 07:40:12.102938 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept: application/json Aug 24 07:40:12.102938 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept-Encoding: identity Aug 24 07:40:12.102938 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Connection: close Aug 24 07:40:12.102938 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Length: 0 Aug 24 07:40:12.102938 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Type: application/json Aug 24 07:40:12.102938 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Host: 10.222.0.42 Aug 24 07:40:12.102938 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Openstack-System-Scope: None Aug 24 07:40:12.102938 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: User-Agent: python-urllib3/1.26.11 Aug 24 07:40:12.102938 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Auth-Token: gAAAAABjBdXSHEVJV_jnpMHuIYI5vDl_IphTBnGMXO7aDjwXkg6h6GXWL5uxlk1OuDoVHztqeNRSfWxwW5z96YpzKObIFzHnZvJ5Bd8j7S06ljAmMqKCY3JwGSZ9jNFOzAN9Us0I77VftT6hkADGLj58b84GQc4iv0upn4IzaAzKxVLed45PZko Aug 24 07:40:12.102938 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Id: None Aug 24 07:40:12.102938 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Name: None Aug 24 07:40:12.102938 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Identity-Status: Confirmed Aug 24 07:40:12.102938 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Is-Admin-Project: True Aug 24 07:40:12.102938 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Id: default Aug 24 07:40:12.102938 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Name: Default Aug 24 07:40:12.102938 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Id: c128cf48470d4bcd91059b10fe41b68b Aug 24 07:40:12.102938 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-656432460 Aug 24 07:40:12.102938 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Role: reader,member Aug 24 07:40:12.102938 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Roles: reader,member Aug 24 07:40:12.104060 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c128cf48470d4bcd91059b10fe41b68b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c128cf48470d4bcd91059b10fe41b68b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c128cf48470d4bcd91059b10fe41b68b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c128cf48470d4bcd91059b10fe41b68b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:40:12.104060 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant: tempest-VolumesSnapshotsTestJSON-656432460 Aug 24 07:40:12.104060 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Id: c128cf48470d4bcd91059b10fe41b68b Aug 24 07:40:12.104060 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-656432460 Aug 24 07:40:12.104060 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User: tempest-VolumesSnapshotsTestJSON-656432460-project Aug 24 07:40:12.104060 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Id: default Aug 24 07:40:12.104060 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Name: Default Aug 24 07:40:12.104060 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Id: b30a8ed4973a4649baccb9963ceb84cb Aug 24 07:40:12.104060 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Name: tempest-VolumesSnapshotsTestJSON-656432460-project Aug 24 07:40:12.104060 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: method: Aug 24 07:40:12.104060 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: exception: Snapshot 8cb88373-3d1e-499e-aa39-bbbbb3f5dea3 could not be found. Aug 24 07:40:12.104060 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: action_args: {'id': '8cb88373-3d1e-499e-aa39-bbbbb3f5dea3'} Aug 24 07:40:12.104060 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:40:12.104816 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:40:12.104816 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 07:40:12.104816 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 07:40:12.104816 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 07:40:12.104816 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 07:40:12.104816 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 07:40:12.104816 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 07:40:12.104816 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 07:40:12.104816 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 07:40:12.104816 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 07:40:12.104816 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 07:40:12.104816 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 07:40:12.104816 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 07:40:12.104816 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 07:40:12.104816 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 07:40:12.104816 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 8cb88373-3d1e-499e-aa39-bbbbb3f5dea3 could not be found. (HTTP 404) (Request-ID: req-aff73668-c995-48d3-981d-b8a5b44058ac) Aug 24 07:40:12.104816 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:40:12.104816 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:40:12.105744 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:40:12.105744 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:40:12.105744 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 24 07:40:12.105744 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 24 07:40:12.105744 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 07:40:12.105744 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 07:40:12.105744 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 24 07:40:12.105744 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 24 07:40:12.105744 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 07:40:12.105744 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 07:40:12.105744 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 07:40:12.105744 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 07:40:12.105744 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 07:40:12.105744 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 07:40:12.105744 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 07:40:12.105744 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 07:40:12.105744 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 07:40:12.105744 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 07:40:12.105744 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 07:40:12.106638 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 07:40:12.106638 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 07:40:12.106638 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 07:40:12.106638 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 07:40:12.106638 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 07:40:12.106638 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 8cb88373-3d1e-499e-aa39-bbbbb3f5dea3 could not be found. Aug 24 07:40:12.106638 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:40:12.106638 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:40:12.106638 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:40:12.106638 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:40:12.106638 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:40:12.106638 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:40:12.106638 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:40:12.106638 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:40:12.106638 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 07:40:12.106638 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 07:40:12.106638 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:40:12.106638 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:40:12.106638 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 24 07:40:12.106638 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:40:12.107819 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 8cb88373-3d1e-499e-aa39-bbbbb3f5dea3 could not be found. Aug 24 07:40:12.107819 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:40:12.107819 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:40:12.107819 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:40:12.107819 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:40:12.107819 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:40:12.107819 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:40:12.107819 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:40:12.107819 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:40:12.107819 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 8cb88373-3d1e-499e-aa39-bbbbb3f5dea3 could not be found. Aug 24 07:40:12.107819 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:40:12.107819 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-3e68187b-e0bc-481f-a154-408d6d37d4b0 tempest-VolumesSnapshotsTestJSON-656432460 tempest-VolumesSnapshotsTestJSON-656432460-project] Returning 404 to user: Snapshot 8cb88373-3d1e-499e-aa39-bbbbb3f5dea3 could not be found. {{(pid=127114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:40:12.107819 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-3e68187b-e0bc-481f-a154-408d6d37d4b0 tempest-VolumesSnapshotsTestJSON-656432460 tempest-VolumesSnapshotsTestJSON-656432460-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/8cb88373-3d1e-499e-aa39-bbbbb3f5dea3" status: 404 len: 111 microversion: 2.1 time: 0.204279 Aug 24 07:40:12.107819 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 13/25] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Aug 24 07:40:11 2022] GET /compute/v2.1/os-snapshots/8cb88373-3d1e-499e-aa39-bbbbb3f5dea3 => generated 111 bytes in 206 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:40:12.121211 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-957db873-481b-430a-b766-5e40c651951e tempest-VolumesSnapshotsTestJSON-656432460 tempest-VolumesSnapshotsTestJSON-656432460-project] Calling method '.version_select at 0x7faf69b551f0>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:12.149224 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-5eec9626-e7e5-4424-8724-28bc6d195591 tempest-VolumesTestJSON-1106249829 tempest-VolumesTestJSON-1106249829-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.365908 Aug 24 07:40:12.158772 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 13/26] 10.222.0.42 () {58 vars in 1167 bytes} [Wed Aug 24 07:40:11 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:40:12.266075 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-957db873-481b-430a-b766-5e40c651951e tempest-VolumesSnapshotsTestJSON-656432460 tempest-VolumesSnapshotsTestJSON-656432460-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/2015ac70-45e6-455c-80e9-2470080cc44a" status: 202 len: 0 microversion: 2.1 time: 0.153847 Aug 24 07:40:12.268467 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 14/27] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Aug 24 07:40:12 2022] DELETE /compute/v2.1/os-volumes/2015ac70-45e6-455c-80e9-2470080cc44a => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 07:40:12.279112 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-c079abc7-e421-4e5d-8835-b0cee55eb994 tempest-VolumesTestJSON-1106249829 tempest-VolumesTestJSON-1106249829-project] Calling method '.version_select at 0x7faf6a5a8af0>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:12.479568 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-c079abc7-e421-4e5d-8835-b0cee55eb994 tempest-VolumesTestJSON-1106249829 tempest-VolumesTestJSON-1106249829-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.209278 Aug 24 07:40:12.480877 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 15/28] 10.222.0.42 () {58 vars in 1170 bytes} [Wed Aug 24 07:40:12 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:40:12.491972 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-4707ebe5-8a53-4e0e-9e02-f003e8e5708d tempest-VolumesSnapshotsTestJSON-656432460 tempest-VolumesSnapshotsTestJSON-656432460-project] Calling method '.version_select at 0x7faf69b55310>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:12.520923 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-3245b1a5-23dd-4535-b31d-80802706d387 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Action: 'create', calling method: .version_select at 0x7faf69be0940>, body: {"keypair": {"name": "tempest-keypair-342720773", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsELx4QFXJ4v4QIg3YqpI0/6OR+XzMEjkzjxTjAwlA+9K0dCwxK8EW8OZRh8CTRqZmPXitalphX3B9fNZqa+Jp3qfy05kYtx0dcDWbPL49hNziMGA8SK+DLfbUgaQYP+w=="}} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:40:12.605325 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.wsgi [None req-4707ebe5-8a53-4e0e-9e02-f003e8e5708d tempest-VolumesSnapshotsTestJSON-656432460 tempest-VolumesSnapshotsTestJSON-656432460-project] HTTP exception thrown: Volume 2015ac70-45e6-455c-80e9-2470080cc44a could not be found. Aug 24 07:40:12.607596 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-4707ebe5-8a53-4e0e-9e02-f003e8e5708d tempest-VolumesSnapshotsTestJSON-656432460 tempest-VolumesSnapshotsTestJSON-656432460-project] Request method failure captured: Aug 24 07:40:12.607596 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: request: GET /compute/v2.1/os-volumes/2015ac70-45e6-455c-80e9-2470080cc44a HTTP/1.1 Aug 24 07:40:12.607596 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept: application/json Aug 24 07:40:12.607596 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept-Encoding: identity Aug 24 07:40:12.607596 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Connection: close Aug 24 07:40:12.607596 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Length: 0 Aug 24 07:40:12.607596 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Type: application/json Aug 24 07:40:12.607596 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Host: 10.222.0.42 Aug 24 07:40:12.607596 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Openstack-System-Scope: None Aug 24 07:40:12.607596 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: User-Agent: python-urllib3/1.26.11 Aug 24 07:40:12.607596 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Auth-Token: gAAAAABjBdXSHEVJV_jnpMHuIYI5vDl_IphTBnGMXO7aDjwXkg6h6GXWL5uxlk1OuDoVHztqeNRSfWxwW5z96YpzKObIFzHnZvJ5Bd8j7S06ljAmMqKCY3JwGSZ9jNFOzAN9Us0I77VftT6hkADGLj58b84GQc4iv0upn4IzaAzKxVLed45PZko Aug 24 07:40:12.607596 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Id: None Aug 24 07:40:12.607596 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Name: None Aug 24 07:40:12.607596 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Identity-Status: Confirmed Aug 24 07:40:12.607596 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Is-Admin-Project: True Aug 24 07:40:12.607596 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Id: default Aug 24 07:40:12.607596 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Name: Default Aug 24 07:40:12.607596 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Id: c128cf48470d4bcd91059b10fe41b68b Aug 24 07:40:12.607596 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-656432460 Aug 24 07:40:12.607596 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Role: reader,member Aug 24 07:40:12.607596 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Roles: reader,member Aug 24 07:40:12.608653 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c128cf48470d4bcd91059b10fe41b68b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c128cf48470d4bcd91059b10fe41b68b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c128cf48470d4bcd91059b10fe41b68b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c128cf48470d4bcd91059b10fe41b68b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:40:12.608653 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant: tempest-VolumesSnapshotsTestJSON-656432460 Aug 24 07:40:12.608653 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Id: c128cf48470d4bcd91059b10fe41b68b Aug 24 07:40:12.608653 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-656432460 Aug 24 07:40:12.608653 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User: tempest-VolumesSnapshotsTestJSON-656432460-project Aug 24 07:40:12.608653 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Id: default Aug 24 07:40:12.608653 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Name: Default Aug 24 07:40:12.608653 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Id: b30a8ed4973a4649baccb9963ceb84cb Aug 24 07:40:12.608653 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Name: tempest-VolumesSnapshotsTestJSON-656432460-project Aug 24 07:40:12.608653 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: method: Aug 24 07:40:12.608653 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: exception: Volume 2015ac70-45e6-455c-80e9-2470080cc44a could not be found. Aug 24 07:40:12.608653 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: action_args: {'id': '2015ac70-45e6-455c-80e9-2470080cc44a'} Aug 24 07:40:12.608653 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:40:12.609269 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:40:12.609269 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 07:40:12.609269 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 07:40:12.609269 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 07:40:12.609269 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 07:40:12.609269 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 07:40:12.609269 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 07:40:12.609269 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 07:40:12.609269 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 07:40:12.609269 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 07:40:12.609269 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 07:40:12.609269 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 07:40:12.609269 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 07:40:12.609269 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 07:40:12.609269 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 07:40:12.609269 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2015ac70-45e6-455c-80e9-2470080cc44a could not be found. (HTTP 404) (Request-ID: req-4502057d-e7ec-4d91-8cae-9a24dd1ba184) Aug 24 07:40:12.609269 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:40:12.609269 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:40:12.609269 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:40:12.610656 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:40:12.610656 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 07:40:12.610656 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 07:40:12.610656 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 07:40:12.610656 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 07:40:12.610656 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 07:40:12.610656 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 07:40:12.610656 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 07:40:12.610656 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 07:40:12.610656 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 07:40:12.610656 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 07:40:12.610656 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 07:40:12.610656 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 07:40:12.610656 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 07:40:12.610656 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 07:40:12.610656 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 07:40:12.610656 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 07:40:12.610656 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 07:40:12.610656 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 07:40:12.611541 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 07:40:12.611541 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 07:40:12.611541 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 07:40:12.611541 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 07:40:12.611541 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2015ac70-45e6-455c-80e9-2470080cc44a could not be found. Aug 24 07:40:12.611541 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:40:12.611541 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:40:12.611541 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:40:12.611541 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:40:12.611541 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:40:12.611541 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:40:12.611541 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:40:12.611541 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:40:12.611541 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 07:40:12.611541 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 07:40:12.611541 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:40:12.611541 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:40:12.611541 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 07:40:12.611541 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:40:12.612422 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2015ac70-45e6-455c-80e9-2470080cc44a could not be found. Aug 24 07:40:12.612422 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:40:12.612422 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:40:12.612422 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:40:12.612422 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:40:12.612422 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:40:12.612422 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:40:12.612422 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:40:12.612422 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:40:12.612422 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2015ac70-45e6-455c-80e9-2470080cc44a could not be found. Aug 24 07:40:12.612422 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:40:12.612422 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-4707ebe5-8a53-4e0e-9e02-f003e8e5708d tempest-VolumesSnapshotsTestJSON-656432460 tempest-VolumesSnapshotsTestJSON-656432460-project] Returning 404 to user: Volume 2015ac70-45e6-455c-80e9-2470080cc44a could not be found. {{(pid=127114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:40:12.612422 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-4707ebe5-8a53-4e0e-9e02-f003e8e5708d tempest-VolumesSnapshotsTestJSON-656432460 tempest-VolumesSnapshotsTestJSON-656432460-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/2015ac70-45e6-455c-80e9-2470080cc44a" status: 404 len: 109 microversion: 2.1 time: 0.126782 Aug 24 07:40:12.612422 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 16/29] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Aug 24 07:40:12 2022] GET /compute/v2.1/os-volumes/2015ac70-45e6-455c-80e9-2470080cc44a => generated 109 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:40:12.627016 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-22e7c580-f3be-446b-882a-50c3425b5c03 tempest-VolumesTestJSON-1106249829 tempest-VolumesTestJSON-1106249829-project] Calling method '.version_select at 0x7faf69cfb700>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:12.733183 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.quota [None req-3245b1a5-23dd-4535-b31d-80802706d387 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Getting quotas for project 3e9b29dbfd404c008fe871808d41e059. Resources: {'key_pairs'} {{(pid=127113) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:40:12.747373 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.quota [None req-3245b1a5-23dd-4535-b31d-80802706d387 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Getting quotas for user 072548785a38488db94ee05dfbf8c8ec and project 3e9b29dbfd404c008fe871808d41e059. Resources: {'key_pairs'} {{(pid=127113) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:40:12.817979 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-22e7c580-f3be-446b-882a-50c3425b5c03 tempest-VolumesTestJSON-1106249829 tempest-VolumesTestJSON-1106249829-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.205826 Aug 24 07:40:12.819416 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 17/30] 10.222.0.42 () {58 vars in 1155 bytes} [Wed Aug 24 07:40:12 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:40:12.824101 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-3d0ad0e1-ea3b-4002-b299-762d669178c2 tempest-VolumesSnapshotsTestJSON-656432460 tempest-VolumesSnapshotsTestJSON-656432460-project] Calling method '.version_select at 0x7faf6a5a8b80>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:12.894491 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-3245b1a5-23dd-4535-b31d-80802706d387 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.734475 Aug 24 07:40:12.895730 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 14/31] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Aug 24 07:40:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:40:12.910383 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-9750901f-228c-49ef-8b21-33afae8148ea tempest-VolumesTestJSON-1106249829 tempest-VolumesTestJSON-1106249829-project] Calling method '.version_select at 0x7faf69b5b3a0>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:12.925560 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.wsgi [None req-3d0ad0e1-ea3b-4002-b299-762d669178c2 tempest-VolumesSnapshotsTestJSON-656432460 tempest-VolumesSnapshotsTestJSON-656432460-project] HTTP exception thrown: Volume 2015ac70-45e6-455c-80e9-2470080cc44a could not be found. Aug 24 07:40:12.931328 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-3d0ad0e1-ea3b-4002-b299-762d669178c2 tempest-VolumesSnapshotsTestJSON-656432460 tempest-VolumesSnapshotsTestJSON-656432460-project] Request method failure captured: Aug 24 07:40:12.931328 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: request: DELETE /compute/v2.1/os-volumes/2015ac70-45e6-455c-80e9-2470080cc44a HTTP/1.1 Aug 24 07:40:12.931328 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept: application/json Aug 24 07:40:12.931328 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept-Encoding: identity Aug 24 07:40:12.931328 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Connection: close Aug 24 07:40:12.931328 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Length: 0 Aug 24 07:40:12.931328 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Type: application/json Aug 24 07:40:12.931328 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Host: 10.222.0.42 Aug 24 07:40:12.931328 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Openstack-System-Scope: None Aug 24 07:40:12.931328 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: User-Agent: python-urllib3/1.26.11 Aug 24 07:40:12.931328 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Auth-Token: gAAAAABjBdXSHEVJV_jnpMHuIYI5vDl_IphTBnGMXO7aDjwXkg6h6GXWL5uxlk1OuDoVHztqeNRSfWxwW5z96YpzKObIFzHnZvJ5Bd8j7S06ljAmMqKCY3JwGSZ9jNFOzAN9Us0I77VftT6hkADGLj58b84GQc4iv0upn4IzaAzKxVLed45PZko Aug 24 07:40:12.931328 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Id: None Aug 24 07:40:12.931328 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Name: None Aug 24 07:40:12.931328 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Identity-Status: Confirmed Aug 24 07:40:12.931328 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Is-Admin-Project: True Aug 24 07:40:12.931328 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Id: default Aug 24 07:40:12.931328 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Name: Default Aug 24 07:40:12.931328 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Id: c128cf48470d4bcd91059b10fe41b68b Aug 24 07:40:12.931328 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-656432460 Aug 24 07:40:12.931328 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Role: reader,member Aug 24 07:40:12.931328 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Roles: reader,member Aug 24 07:40:12.932611 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c128cf48470d4bcd91059b10fe41b68b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c128cf48470d4bcd91059b10fe41b68b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c128cf48470d4bcd91059b10fe41b68b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c128cf48470d4bcd91059b10fe41b68b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:40:12.932611 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant: tempest-VolumesSnapshotsTestJSON-656432460 Aug 24 07:40:12.932611 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Id: c128cf48470d4bcd91059b10fe41b68b Aug 24 07:40:12.932611 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-656432460 Aug 24 07:40:12.932611 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User: tempest-VolumesSnapshotsTestJSON-656432460-project Aug 24 07:40:12.932611 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Id: default Aug 24 07:40:12.932611 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Name: Default Aug 24 07:40:12.932611 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Id: b30a8ed4973a4649baccb9963ceb84cb Aug 24 07:40:12.932611 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Name: tempest-VolumesSnapshotsTestJSON-656432460-project Aug 24 07:40:12.932611 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: method: Aug 24 07:40:12.932611 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: exception: Volume 2015ac70-45e6-455c-80e9-2470080cc44a could not be found. Aug 24 07:40:12.932611 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: action_args: {'id': '2015ac70-45e6-455c-80e9-2470080cc44a'} Aug 24 07:40:12.932611 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:40:12.933842 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:40:12.933842 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 07:40:12.933842 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 07:40:12.933842 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 07:40:12.933842 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 07:40:12.933842 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 07:40:12.933842 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 07:40:12.933842 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 07:40:12.933842 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 07:40:12.933842 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 07:40:12.933842 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 07:40:12.933842 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 07:40:12.933842 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 07:40:12.933842 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 07:40:12.933842 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 07:40:12.933842 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2015ac70-45e6-455c-80e9-2470080cc44a could not be found. (HTTP 404) (Request-ID: req-041dc066-44f3-4e01-b980-afe86bc13e3d) Aug 24 07:40:12.933842 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:40:12.933842 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:40:12.933842 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:40:12.935226 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:40:12.935226 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 07:40:12.935226 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 07:40:12.935226 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 07:40:12.935226 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 07:40:12.935226 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 07:40:12.935226 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 07:40:12.935226 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 07:40:12.935226 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 07:40:12.935226 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 07:40:12.935226 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 07:40:12.935226 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 07:40:12.935226 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 07:40:12.935226 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 07:40:12.935226 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 07:40:12.935226 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 07:40:12.935226 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 07:40:12.935226 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 07:40:12.935226 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 07:40:12.936159 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 07:40:12.936159 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 07:40:12.936159 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 07:40:12.936159 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 07:40:12.936159 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2015ac70-45e6-455c-80e9-2470080cc44a could not be found. Aug 24 07:40:12.936159 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:40:12.936159 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:40:12.936159 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:40:12.936159 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:40:12.936159 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:40:12.936159 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:40:12.936159 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:40:12.936159 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:40:12.936159 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 07:40:12.936159 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 07:40:12.936159 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:40:12.936159 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:40:12.936159 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 07:40:12.936159 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:40:12.939366 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2015ac70-45e6-455c-80e9-2470080cc44a could not be found. Aug 24 07:40:12.939366 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:40:12.939366 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:40:12.939366 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:40:12.939366 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:40:12.939366 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:40:12.939366 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:40:12.939366 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:40:12.939366 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:40:12.939366 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2015ac70-45e6-455c-80e9-2470080cc44a could not be found. Aug 24 07:40:12.939366 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:40:12.939366 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-3d0ad0e1-ea3b-4002-b299-762d669178c2 tempest-VolumesSnapshotsTestJSON-656432460 tempest-VolumesSnapshotsTestJSON-656432460-project] Returning 404 to user: Volume 2015ac70-45e6-455c-80e9-2470080cc44a could not be found. {{(pid=127114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:40:12.939366 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-3d0ad0e1-ea3b-4002-b299-762d669178c2 tempest-VolumesSnapshotsTestJSON-656432460 tempest-VolumesSnapshotsTestJSON-656432460-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/2015ac70-45e6-455c-80e9-2470080cc44a" status: 404 len: 109 microversion: 2.1 time: 0.112679 Aug 24 07:40:12.939366 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 18/32] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Aug 24 07:40:12 2022] DELETE /compute/v2.1/os-volumes/2015ac70-45e6-455c-80e9-2470080cc44a => generated 109 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:40:12.947071 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-9bbcf307-08d8-44e5-b37c-01d083bb799b tempest-VolumesSnapshotsTestJSON-656432460 tempest-VolumesSnapshotsTestJSON-656432460-project] Calling method '.version_select at 0x7faf69b64280>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:13.002215 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.wsgi [None req-9bbcf307-08d8-44e5-b37c-01d083bb799b tempest-VolumesSnapshotsTestJSON-656432460 tempest-VolumesSnapshotsTestJSON-656432460-project] HTTP exception thrown: Volume 2015ac70-45e6-455c-80e9-2470080cc44a could not be found. Aug 24 07:40:13.004296 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-9bbcf307-08d8-44e5-b37c-01d083bb799b tempest-VolumesSnapshotsTestJSON-656432460 tempest-VolumesSnapshotsTestJSON-656432460-project] Request method failure captured: Aug 24 07:40:13.004296 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: request: GET /compute/v2.1/os-volumes/2015ac70-45e6-455c-80e9-2470080cc44a HTTP/1.1 Aug 24 07:40:13.004296 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept: application/json Aug 24 07:40:13.004296 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept-Encoding: identity Aug 24 07:40:13.004296 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Connection: close Aug 24 07:40:13.004296 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Length: 0 Aug 24 07:40:13.004296 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Type: application/json Aug 24 07:40:13.004296 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Host: 10.222.0.42 Aug 24 07:40:13.004296 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Openstack-System-Scope: None Aug 24 07:40:13.004296 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: User-Agent: python-urllib3/1.26.11 Aug 24 07:40:13.004296 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Auth-Token: gAAAAABjBdXSHEVJV_jnpMHuIYI5vDl_IphTBnGMXO7aDjwXkg6h6GXWL5uxlk1OuDoVHztqeNRSfWxwW5z96YpzKObIFzHnZvJ5Bd8j7S06ljAmMqKCY3JwGSZ9jNFOzAN9Us0I77VftT6hkADGLj58b84GQc4iv0upn4IzaAzKxVLed45PZko Aug 24 07:40:13.004296 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Id: None Aug 24 07:40:13.004296 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Name: None Aug 24 07:40:13.004296 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Identity-Status: Confirmed Aug 24 07:40:13.004296 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Is-Admin-Project: True Aug 24 07:40:13.004296 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Id: default Aug 24 07:40:13.004296 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Name: Default Aug 24 07:40:13.004296 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Id: c128cf48470d4bcd91059b10fe41b68b Aug 24 07:40:13.004296 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-656432460 Aug 24 07:40:13.004296 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Role: reader,member Aug 24 07:40:13.004296 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Roles: reader,member Aug 24 07:40:13.005687 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c128cf48470d4bcd91059b10fe41b68b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c128cf48470d4bcd91059b10fe41b68b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c128cf48470d4bcd91059b10fe41b68b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c128cf48470d4bcd91059b10fe41b68b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:40:13.005687 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant: tempest-VolumesSnapshotsTestJSON-656432460 Aug 24 07:40:13.005687 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Id: c128cf48470d4bcd91059b10fe41b68b Aug 24 07:40:13.005687 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-656432460 Aug 24 07:40:13.005687 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User: tempest-VolumesSnapshotsTestJSON-656432460-project Aug 24 07:40:13.005687 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Id: default Aug 24 07:40:13.005687 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Name: Default Aug 24 07:40:13.005687 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Id: b30a8ed4973a4649baccb9963ceb84cb Aug 24 07:40:13.005687 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Name: tempest-VolumesSnapshotsTestJSON-656432460-project Aug 24 07:40:13.005687 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: method: Aug 24 07:40:13.005687 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: exception: Volume 2015ac70-45e6-455c-80e9-2470080cc44a could not be found. Aug 24 07:40:13.005687 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: action_args: {'id': '2015ac70-45e6-455c-80e9-2470080cc44a'} Aug 24 07:40:13.005687 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:40:13.006307 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:40:13.006307 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 07:40:13.006307 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 07:40:13.006307 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 07:40:13.006307 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 07:40:13.006307 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 07:40:13.006307 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 07:40:13.006307 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 07:40:13.006307 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 07:40:13.006307 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 07:40:13.006307 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 07:40:13.006307 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 07:40:13.006307 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 07:40:13.006307 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 07:40:13.006307 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 07:40:13.006307 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2015ac70-45e6-455c-80e9-2470080cc44a could not be found. (HTTP 404) (Request-ID: req-eb16596f-8d57-4a98-93bb-7ec5e0985d0c) Aug 24 07:40:13.006307 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:40:13.006307 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:40:13.006307 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:40:13.008174 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:40:13.008174 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 07:40:13.008174 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 07:40:13.008174 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 07:40:13.008174 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 07:40:13.008174 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 07:40:13.008174 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 07:40:13.008174 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 07:40:13.008174 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 07:40:13.008174 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 07:40:13.008174 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 07:40:13.008174 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 07:40:13.008174 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 07:40:13.008174 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 07:40:13.008174 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 07:40:13.008174 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 07:40:13.008174 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 07:40:13.008174 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 07:40:13.008174 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 07:40:13.009220 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 07:40:13.009220 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 07:40:13.009220 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 07:40:13.009220 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 07:40:13.009220 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2015ac70-45e6-455c-80e9-2470080cc44a could not be found. Aug 24 07:40:13.009220 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:40:13.009220 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:40:13.009220 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:40:13.009220 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:40:13.009220 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:40:13.009220 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:40:13.009220 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:40:13.009220 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:40:13.009220 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 07:40:13.009220 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 07:40:13.009220 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:40:13.009220 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:40:13.009220 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 07:40:13.009220 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:40:13.011585 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2015ac70-45e6-455c-80e9-2470080cc44a could not be found. Aug 24 07:40:13.011585 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:40:13.011585 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:40:13.011585 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:40:13.011585 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:40:13.011585 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:40:13.011585 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:40:13.011585 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:40:13.011585 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:40:13.011585 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2015ac70-45e6-455c-80e9-2470080cc44a could not be found. Aug 24 07:40:13.011585 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:40:13.011585 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-9bbcf307-08d8-44e5-b37c-01d083bb799b tempest-VolumesSnapshotsTestJSON-656432460 tempest-VolumesSnapshotsTestJSON-656432460-project] Returning 404 to user: Volume 2015ac70-45e6-455c-80e9-2470080cc44a could not be found. {{(pid=127114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:40:13.011585 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-9bbcf307-08d8-44e5-b37c-01d083bb799b tempest-VolumesSnapshotsTestJSON-656432460 tempest-VolumesSnapshotsTestJSON-656432460-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/2015ac70-45e6-455c-80e9-2470080cc44a" status: 404 len: 109 microversion: 2.1 time: 0.068681 Aug 24 07:40:13.011585 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 19/33] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Aug 24 07:40:12 2022] GET /compute/v2.1/os-volumes/2015ac70-45e6-455c-80e9-2470080cc44a => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 07:40:13.067073 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-9750901f-228c-49ef-8b21-33afae8148ea tempest-VolumesTestJSON-1106249829 tempest-VolumesTestJSON-1106249829-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.169592 Aug 24 07:40:13.080090 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 15/34] 10.222.0.42 () {58 vars in 1188 bytes} [Wed Aug 24 07:40:12 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:40:13.086989 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-4ef855d8-5c2c-4c3d-9758-0e3920b58000 tempest-VolumesTestJSON-1106249829 tempest-VolumesTestJSON-1106249829-project] Calling method '.version_select at 0x7faf69bd18b0>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:13.363480 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-4ef855d8-5c2c-4c3d-9758-0e3920b58000 tempest-VolumesTestJSON-1106249829 tempest-VolumesTestJSON-1106249829-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.281144 Aug 24 07:40:13.364391 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 20/35] 10.222.0.42 () {58 vars in 1155 bytes} [Wed Aug 24 07:40:13 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:40:17.868478 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-54cf175d-0887-4670-8f04-1809124286d7 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1469519768", "imageRef": "4358f547-a499-43f3-9c84-925d78cd73db", "flavorRef": "452", "networks": [{"uuid": "d2e3aba6-7787-4da5-9827-cfd995082fb4"}]}} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:40:18.075891 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-96750895-477b-47b9-87a0-146f6b93b615 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-113396683", "imageRef": "4358f547-a499-43f3-9c84-925d78cd73db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5fad6b53-b767-43a2-a080-e8a313d40535"}], "security_groups": [{"name": "tempest-securitygroup--2134118835"}], "key_name": "tempest-keypair-342720773", "user_data": "}} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:40:18.111953 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.network.neutron [None req-54cf175d-0887-4670-8f04-1809124286d7 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] validate_networks() for [('d2e3aba6-7787-4da5-9827-cfd995082fb4', None, None, None, None, None)] {{(pid=127113) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 07:40:18.758355 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.network.neutron [None req-96750895-477b-47b9-87a0-146f6b93b615 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] validate_networks() for [('5fad6b53-b767-43a2-a080-e8a313d40535', None, None, None, None, None)] {{(pid=127114) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 07:40:20.832552 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.virt.hardware [None req-54cf175d-0887-4670-8f04-1809124286d7 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Flavor limits 0:0:0 {{(pid=127113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 07:40:20.835656 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.virt.hardware [None req-54cf175d-0887-4670-8f04-1809124286d7 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Image limits 0:0:0 {{(pid=127113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 07:40:20.839313 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.virt.hardware [None req-54cf175d-0887-4670-8f04-1809124286d7 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Flavor pref 0:0:0 {{(pid=127113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 07:40:20.840387 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.virt.hardware [None req-54cf175d-0887-4670-8f04-1809124286d7 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Image pref 0:0:0 {{(pid=127113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 07:40:20.841869 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.virt.hardware [None req-54cf175d-0887-4670-8f04-1809124286d7 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 07:40:20.882742 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-54cf175d-0887-4670-8f04-1809124286d7 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:20.883252 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-54cf175d-0887-4670-8f04-1809124286d7 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:20.883690 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-54cf175d-0887-4670-8f04-1809124286d7 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:20.884432 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-54cf175d-0887-4670-8f04-1809124286d7 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:20.884887 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-54cf175d-0887-4670-8f04-1809124286d7 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:20.885309 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-54cf175d-0887-4670-8f04-1809124286d7 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:20.952188 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.quota [None req-54cf175d-0887-4670-8f04-1809124286d7 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Getting quotas for project 7ca17bd7984241b1bbca7854ceb9440b. Resources: {'cores', 'ram', 'instances'} {{(pid=127113) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:40:20.963300 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.quota [None req-54cf175d-0887-4670-8f04-1809124286d7 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Getting quotas for user 62897a3ee86d4dbbae38e801ad31ea07 and project 7ca17bd7984241b1bbca7854ceb9440b. Resources: {'cores', 'ram', 'instances'} {{(pid=127113) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:40:21.019983 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-54cf175d-0887-4670-8f04-1809124286d7 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Going to run 1 instances... {{(pid=127113) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 07:40:21.037230 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-54cf175d-0887-4670-8f04-1809124286d7 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] [instance: 3a8c9525-0e7d-40f7-861f-e59324e08a1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4358f547-a499-43f3-9c84-925d78cd73db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127113) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 07:40:21.159927 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-96750895-477b-47b9-87a0-146f6b93b615 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Flavor limits 0:0:0 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 07:40:21.161063 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-96750895-477b-47b9-87a0-146f6b93b615 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Image limits 0:0:0 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 07:40:21.161726 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-96750895-477b-47b9-87a0-146f6b93b615 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Flavor pref 0:0:0 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 07:40:21.163733 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-96750895-477b-47b9-87a0-146f6b93b615 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Image pref 0:0:0 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 07:40:21.164655 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-96750895-477b-47b9-87a0-146f6b93b615 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 07:40:21.195065 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-54cf175d-0887-4670-8f04-1809124286d7 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.043543 Aug 24 07:40:21.195841 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 16/36] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 24 07:40:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 4045 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 07:40:21.213503 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-96750895-477b-47b9-87a0-146f6b93b615 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:21.213981 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-96750895-477b-47b9-87a0-146f6b93b615 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:21.214403 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-96750895-477b-47b9-87a0-146f6b93b615 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:21.215933 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-96750895-477b-47b9-87a0-146f6b93b615 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:21.217232 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-96750895-477b-47b9-87a0-146f6b93b615 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:21.219387 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-96750895-477b-47b9-87a0-146f6b93b615 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:21.320846 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.quota [None req-96750895-477b-47b9-87a0-146f6b93b615 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Getting quotas for project 3e9b29dbfd404c008fe871808d41e059. Resources: {'cores', 'ram', 'instances'} {{(pid=127114) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:40:21.347654 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.quota [None req-96750895-477b-47b9-87a0-146f6b93b615 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Getting quotas for user 072548785a38488db94ee05dfbf8c8ec and project 3e9b29dbfd404c008fe871808d41e059. Resources: {'cores', 'ram', 'instances'} {{(pid=127114) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:40:21.373022 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-96750895-477b-47b9-87a0-146f6b93b615 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Going to run 1 instances... {{(pid=127114) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 07:40:21.376683 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-96750895-477b-47b9-87a0-146f6b93b615 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4358f547-a499-43f3-9c84-925d78cd73db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127114) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 07:40:21.565731 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-96750895-477b-47b9-87a0-146f6b93b615 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.495368 Aug 24 07:40:21.567468 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 21/37] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 24 07:40:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 3498 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 07:40:21.577796 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-253fe707-0d8c-4a11-99f3-1bf619975159 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:21.584331 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-253fe707-0d8c-4a11-99f3-1bf619975159 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] [instance: 3a8c9525-0e7d-40f7-861f-e59324e08a1a] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:21.911634 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-253fe707-0d8c-4a11-99f3-1bf619975159 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62897a3ee86d4dbbae38e801ad31ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca17bd7984241b1bbca7854ceb9440b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:21.941390 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-253fe707-0d8c-4a11-99f3-1bf619975159 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] 10.222.0.42 "GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a" status: 200 len: 1215 microversion: 2.1 time: 0.372306 Aug 24 07:40:21.944308 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 22/38] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:21 2022] GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a => generated 1215 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:40:21.957852 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-e3a8f106-efe6-4e12-bff0-bfc6d1d4c9f5 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:21.958560 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-e3a8f106-efe6-4e12-bff0-bfc6d1d4c9f5 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:22.030858 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-58204183-53bb-440e-954d-6208a280b3ee tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-843854704", "imageRef": "4358f547-a499-43f3-9c84-925d78cd73db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:40:22.076133 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-e3a8f106-efe6-4e12-bff0-bfc6d1d4c9f5 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:22.086426 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-e3a8f106-efe6-4e12-bff0-bfc6d1d4c9f5 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 200 len: 1236 microversion: 2.1 time: 0.140546 Aug 24 07:40:22.090502 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 23/39] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:21 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 1236 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:40:22.163218 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.network.neutron [None req-58204183-53bb-440e-954d-6208a280b3ee tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] validate_networks() for [('75bee617-1670-45bb-aad3-4cb896b99f45', None, None, None, None, None)] {{(pid=127113) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 07:40:22.966265 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-b6d8b8cb-46c4-4300-af38-dc5a26f86d2f tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:22.967182 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-b6d8b8cb-46c4-4300-af38-dc5a26f86d2f tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] [instance: 3a8c9525-0e7d-40f7-861f-e59324e08a1a] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:23.123472 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-b6d8b8cb-46c4-4300-af38-dc5a26f86d2f tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62897a3ee86d4dbbae38e801ad31ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca17bd7984241b1bbca7854ceb9440b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:23.142556 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-b6d8b8cb-46c4-4300-af38-dc5a26f86d2f tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] 10.222.0.42 "GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a" status: 200 len: 1215 microversion: 2.1 time: 0.176807 Aug 24 07:40:23.168789 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 24/40] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:22 2022] GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a => generated 1215 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:40:23.211373 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-3ace61ee-6f61-4daa-b768-bea77530dd94 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:23.214063 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-3ace61ee-6f61-4daa-b768-bea77530dd94 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:23.353771 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-3ace61ee-6f61-4daa-b768-bea77530dd94 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:23.374175 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-3ace61ee-6f61-4daa-b768-bea77530dd94 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 200 len: 1236 microversion: 2.1 time: 0.183910 Aug 24 07:40:23.380072 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 25/41] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:23 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 1236 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:40:23.966832 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.virt.hardware [None req-58204183-53bb-440e-954d-6208a280b3ee tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Flavor limits 0:0:0 {{(pid=127113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 07:40:23.968204 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.virt.hardware [None req-58204183-53bb-440e-954d-6208a280b3ee tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Image limits 0:0:0 {{(pid=127113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 07:40:23.969588 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.virt.hardware [None req-58204183-53bb-440e-954d-6208a280b3ee tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Flavor pref 0:0:0 {{(pid=127113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 07:40:23.970513 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.virt.hardware [None req-58204183-53bb-440e-954d-6208a280b3ee tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Image pref 0:0:0 {{(pid=127113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 07:40:23.971340 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.virt.hardware [None req-58204183-53bb-440e-954d-6208a280b3ee tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 07:40:24.001133 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-58204183-53bb-440e-954d-6208a280b3ee tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:24.024831 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-58204183-53bb-440e-954d-6208a280b3ee tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:24.025292 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-58204183-53bb-440e-954d-6208a280b3ee tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:24.030479 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-58204183-53bb-440e-954d-6208a280b3ee tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:24.031076 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-58204183-53bb-440e-954d-6208a280b3ee tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:24.032766 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-58204183-53bb-440e-954d-6208a280b3ee tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:24.103263 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.quota [None req-58204183-53bb-440e-954d-6208a280b3ee tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Getting quotas for project d5672bdc355c4f63885138bd9c7f3497. Resources: {'cores', 'ram', 'instances'} {{(pid=127113) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:40:24.113415 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.quota [None req-58204183-53bb-440e-954d-6208a280b3ee tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Getting quotas for user ea609a2504e64f6f9380061080976a6e and project d5672bdc355c4f63885138bd9c7f3497. Resources: {'cores', 'ram', 'instances'} {{(pid=127113) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:40:24.158516 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-58204183-53bb-440e-954d-6208a280b3ee tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Going to run 1 instances... {{(pid=127113) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 07:40:24.166132 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-58204183-53bb-440e-954d-6208a280b3ee tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4358f547-a499-43f3-9c84-925d78cd73db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127113) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 07:40:24.167970 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-581d6817-5de1-4500-8a6e-e8a18b739bbc tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:24.168596 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-581d6817-5de1-4500-8a6e-e8a18b739bbc tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] [instance: 3a8c9525-0e7d-40f7-861f-e59324e08a1a] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:24.294932 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-581d6817-5de1-4500-8a6e-e8a18b739bbc tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62897a3ee86d4dbbae38e801ad31ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca17bd7984241b1bbca7854ceb9440b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:24.305896 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-581d6817-5de1-4500-8a6e-e8a18b739bbc tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] 10.222.0.42 "GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a" status: 200 len: 1215 microversion: 2.1 time: 0.141554 Aug 24 07:40:24.309845 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 26/42] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:24 2022] GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a => generated 1215 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:40:24.404611 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-0081938b-7f77-4bf6-bfdc-e8300e907c57 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:24.405374 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-0081938b-7f77-4bf6-bfdc-e8300e907c57 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:24.431641 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-58204183-53bb-440e-954d-6208a280b3ee tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.226196 Aug 24 07:40:24.466513 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 17/43] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 24 07:40:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 3267 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 07:40:24.472451 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0081938b-7f77-4bf6-bfdc-e8300e907c57 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:24.478445 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0081938b-7f77-4bf6-bfdc-e8300e907c57 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:24.478977 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0081938b-7f77-4bf6-bfdc-e8300e907c57 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:24.483100 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0081938b-7f77-4bf6-bfdc-e8300e907c57 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:24.488011 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0081938b-7f77-4bf6-bfdc-e8300e907c57 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:24.488504 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0081938b-7f77-4bf6-bfdc-e8300e907c57 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:24.493184 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-917e057b-f932-40fe-b8bf-076b3afa105f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:24.496935 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-917e057b-f932-40fe-b8bf-076b3afa105f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:24.850408 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-917e057b-f932-40fe-b8bf-076b3afa105f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:24.899638 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-917e057b-f932-40fe-b8bf-076b3afa105f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1221 microversion: 2.1 time: 0.428943 Aug 24 07:40:24.901630 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 18/44] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:24 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1221 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:40:25.025481 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-0081938b-7f77-4bf6-bfdc-e8300e907c57 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:25.064637 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-0081938b-7f77-4bf6-bfdc-e8300e907c57 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 200 len: 1240 microversion: 2.1 time: 0.667116 Aug 24 07:40:25.080953 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 27/45] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:24 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 1240 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:40:25.332668 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-f7708f75-ce78-43c0-9318-ff469b76dab6 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:25.333290 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-f7708f75-ce78-43c0-9318-ff469b76dab6 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] [instance: 3a8c9525-0e7d-40f7-861f-e59324e08a1a] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:25.361893 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-2236f96e-f07d-4814-b804-e6b169bd6228 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1740421922", "imageRef": "4358f547-a499-43f3-9c84-925d78cd73db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:40:25.512657 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.network.neutron [None req-2236f96e-f07d-4814-b804-e6b169bd6228 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] validate_networks() for [('75bee617-1670-45bb-aad3-4cb896b99f45', None, None, None, None, None)] {{(pid=127114) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 07:40:25.550526 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-f7708f75-ce78-43c0-9318-ff469b76dab6 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62897a3ee86d4dbbae38e801ad31ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca17bd7984241b1bbca7854ceb9440b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:25.560321 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-f7708f75-ce78-43c0-9318-ff469b76dab6 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] 10.222.0.42 "GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a" status: 200 len: 1215 microversion: 2.1 time: 0.233854 Aug 24 07:40:25.561945 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 19/46] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:25 2022] GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a => generated 1215 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:40:26.095235 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-3e493d44-00a1-46e0-aab5-b7d4bd880cdf tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:26.097855 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-3e493d44-00a1-46e0-aab5-b7d4bd880cdf tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:26.106720 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3e493d44-00a1-46e0-aab5-b7d4bd880cdf tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:26.110095 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3e493d44-00a1-46e0-aab5-b7d4bd880cdf tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:26.114849 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3e493d44-00a1-46e0-aab5-b7d4bd880cdf tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:26.116770 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3e493d44-00a1-46e0-aab5-b7d4bd880cdf tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:26.119244 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3e493d44-00a1-46e0-aab5-b7d4bd880cdf tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:26.121024 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3e493d44-00a1-46e0-aab5-b7d4bd880cdf tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:26.607248 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-3e493d44-00a1-46e0-aab5-b7d4bd880cdf tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:26.661420 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-3e493d44-00a1-46e0-aab5-b7d4bd880cdf tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 200 len: 1306 microversion: 2.1 time: 0.571783 Aug 24 07:40:26.662511 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 20/47] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:26 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 1306 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:40:26.667873 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-8429a879-8efe-4f8d-9abc-76009e25dc31 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:26.668942 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-8429a879-8efe-4f8d-9abc-76009e25dc31 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] [instance: 3a8c9525-0e7d-40f7-861f-e59324e08a1a] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:26.678140 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8429a879-8efe-4f8d-9abc-76009e25dc31 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:26.679168 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8429a879-8efe-4f8d-9abc-76009e25dc31 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:26.680082 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8429a879-8efe-4f8d-9abc-76009e25dc31 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:26.681007 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8429a879-8efe-4f8d-9abc-76009e25dc31 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:26.681845 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8429a879-8efe-4f8d-9abc-76009e25dc31 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:26.682485 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8429a879-8efe-4f8d-9abc-76009e25dc31 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:26.706154 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-2236f96e-f07d-4814-b804-e6b169bd6228 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Flavor limits 0:0:0 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 07:40:26.707290 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-2236f96e-f07d-4814-b804-e6b169bd6228 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Image limits 0:0:0 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 07:40:26.707917 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-2236f96e-f07d-4814-b804-e6b169bd6228 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Flavor pref 0:0:0 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 07:40:26.708474 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-2236f96e-f07d-4814-b804-e6b169bd6228 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Image pref 0:0:0 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 07:40:26.709041 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-2236f96e-f07d-4814-b804-e6b169bd6228 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 07:40:26.737603 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2236f96e-f07d-4814-b804-e6b169bd6228 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:26.740714 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2236f96e-f07d-4814-b804-e6b169bd6228 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:26.742062 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2236f96e-f07d-4814-b804-e6b169bd6228 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:26.747295 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2236f96e-f07d-4814-b804-e6b169bd6228 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:26.751177 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2236f96e-f07d-4814-b804-e6b169bd6228 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:26.751812 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2236f96e-f07d-4814-b804-e6b169bd6228 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:26.816668 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.quota [None req-2236f96e-f07d-4814-b804-e6b169bd6228 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Getting quotas for project d5672bdc355c4f63885138bd9c7f3497. Resources: {'cores', 'ram', 'instances'} {{(pid=127114) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:40:26.859176 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.quota [None req-2236f96e-f07d-4814-b804-e6b169bd6228 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Getting quotas for user ea609a2504e64f6f9380061080976a6e and project d5672bdc355c4f63885138bd9c7f3497. Resources: {'cores', 'ram', 'instances'} {{(pid=127114) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:40:26.898340 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-8429a879-8efe-4f8d-9abc-76009e25dc31 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62897a3ee86d4dbbae38e801ad31ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca17bd7984241b1bbca7854ceb9440b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:26.913395 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-8429a879-8efe-4f8d-9abc-76009e25dc31 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] 10.222.0.42 "GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a" status: 200 len: 1211 microversion: 2.1 time: 0.245911 Aug 24 07:40:26.931268 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-2236f96e-f07d-4814-b804-e6b169bd6228 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Going to run 1 instances... {{(pid=127114) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 07:40:26.934790 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 21/48] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:26 2022] GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a => generated 1211 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:40:26.935803 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-2236f96e-f07d-4814-b804-e6b169bd6228 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4358f547-a499-43f3-9c84-925d78cd73db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127114) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 07:40:27.092743 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-2236f96e-f07d-4814-b804-e6b169bd6228 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.735571 Aug 24 07:40:27.093407 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 28/49] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 24 07:40:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 1737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 07:40:27.109278 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-de414dcf-cedd-4c77-acf3-caedbbf0cbfa tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:27.111027 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-de414dcf-cedd-4c77-acf3-caedbbf0cbfa tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:27.685819 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-a6d9d182-3728-46a5-8656-1973483efa18 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:27.686445 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-a6d9d182-3728-46a5-8656-1973483efa18 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:27.702148 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a6d9d182-3728-46a5-8656-1973483efa18 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:27.702632 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a6d9d182-3728-46a5-8656-1973483efa18 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:27.716356 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a6d9d182-3728-46a5-8656-1973483efa18 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:27.732413 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a6d9d182-3728-46a5-8656-1973483efa18 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:27.732977 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a6d9d182-3728-46a5-8656-1973483efa18 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:27.733356 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a6d9d182-3728-46a5-8656-1973483efa18 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:27.831969 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-de414dcf-cedd-4c77-acf3-caedbbf0cbfa tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:27.844700 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-de414dcf-cedd-4c77-acf3-caedbbf0cbfa tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 200 len: 1222 microversion: 2.1 time: 0.740023 Aug 24 07:40:27.854526 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 22/50] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:27 2022] GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 1222 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:40:27.941347 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-1970038a-ae00-484c-bf54-0066c375f29e tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:27.941951 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-1970038a-ae00-484c-bf54-0066c375f29e tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] [instance: 3a8c9525-0e7d-40f7-861f-e59324e08a1a] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:27.950000 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1970038a-ae00-484c-bf54-0066c375f29e tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:27.950543 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1970038a-ae00-484c-bf54-0066c375f29e tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:27.951005 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1970038a-ae00-484c-bf54-0066c375f29e tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:27.964403 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1970038a-ae00-484c-bf54-0066c375f29e tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:27.965144 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1970038a-ae00-484c-bf54-0066c375f29e tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:27.965735 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1970038a-ae00-484c-bf54-0066c375f29e tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:28.312075 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-1970038a-ae00-484c-bf54-0066c375f29e tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62897a3ee86d4dbbae38e801ad31ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca17bd7984241b1bbca7854ceb9440b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:28.322312 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-1970038a-ae00-484c-bf54-0066c375f29e tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] 10.222.0.42 "GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a" status: 200 len: 1285 microversion: 2.1 time: 0.385722 Aug 24 07:40:28.328053 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 23/51] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:27 2022] GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a => generated 1285 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:40:28.373634 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-a6d9d182-3728-46a5-8656-1973483efa18 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:28.387165 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-a6d9d182-3728-46a5-8656-1973483efa18 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 200 len: 1294 microversion: 2.1 time: 0.705479 Aug 24 07:40:28.391509 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 29/52] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:27 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 1294 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:40:28.867110 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-f61312b5-b16a-4795-9708-e7b0da231440 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:28.868485 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-f61312b5-b16a-4795-9708-e7b0da231440 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:28.876243 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f61312b5-b16a-4795-9708-e7b0da231440 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:28.883188 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f61312b5-b16a-4795-9708-e7b0da231440 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:28.884685 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f61312b5-b16a-4795-9708-e7b0da231440 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:28.886518 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f61312b5-b16a-4795-9708-e7b0da231440 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:28.888758 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f61312b5-b16a-4795-9708-e7b0da231440 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:28.890396 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f61312b5-b16a-4795-9708-e7b0da231440 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:29.250021 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-f61312b5-b16a-4795-9708-e7b0da231440 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:29.259965 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-f61312b5-b16a-4795-9708-e7b0da231440 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 200 len: 1218 microversion: 2.1 time: 0.395415 Aug 24 07:40:29.277319 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 24/53] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:28 2022] GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 1218 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:40:29.344718 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-ee91d829-77e7-46af-8df7-6e3e3b3b64eb tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:29.346094 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-ee91d829-77e7-46af-8df7-6e3e3b3b64eb tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] [instance: 3a8c9525-0e7d-40f7-861f-e59324e08a1a] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:29.356311 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ee91d829-77e7-46af-8df7-6e3e3b3b64eb tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:29.362067 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ee91d829-77e7-46af-8df7-6e3e3b3b64eb tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:29.362841 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ee91d829-77e7-46af-8df7-6e3e3b3b64eb tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:29.364522 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ee91d829-77e7-46af-8df7-6e3e3b3b64eb tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:29.369100 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ee91d829-77e7-46af-8df7-6e3e3b3b64eb tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:29.369548 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ee91d829-77e7-46af-8df7-6e3e3b3b64eb tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:29.414350 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-8d794338-f0e8-4614-a089-c5b43a674e7a tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:29.414996 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-8d794338-f0e8-4614-a089-c5b43a674e7a tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:29.437035 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8d794338-f0e8-4614-a089-c5b43a674e7a tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:29.437532 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8d794338-f0e8-4614-a089-c5b43a674e7a tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:29.438006 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8d794338-f0e8-4614-a089-c5b43a674e7a tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:29.439177 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8d794338-f0e8-4614-a089-c5b43a674e7a tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:29.441503 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8d794338-f0e8-4614-a089-c5b43a674e7a tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:29.450056 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8d794338-f0e8-4614-a089-c5b43a674e7a tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:29.695879 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-ee91d829-77e7-46af-8df7-6e3e3b3b64eb tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62897a3ee86d4dbbae38e801ad31ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca17bd7984241b1bbca7854ceb9440b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:29.745568 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-ee91d829-77e7-46af-8df7-6e3e3b3b64eb tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] 10.222.0.42 "GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a" status: 200 len: 1273 microversion: 2.1 time: 0.372470 Aug 24 07:40:29.746290 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 30/54] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:29 2022] GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a => generated 1273 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:40:29.984544 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-8d794338-f0e8-4614-a089-c5b43a674e7a tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:29.996101 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-8d794338-f0e8-4614-a089-c5b43a674e7a tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 200 len: 1362 microversion: 2.1 time: 0.585408 Aug 24 07:40:29.996686 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 25/55] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:29 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 1362 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:40:30.294292 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-b884a480-769b-4f9e-8542-70e4ee3f4db4 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:30.295861 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-b884a480-769b-4f9e-8542-70e4ee3f4db4 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:30.312711 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b884a480-769b-4f9e-8542-70e4ee3f4db4 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:30.322557 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b884a480-769b-4f9e-8542-70e4ee3f4db4 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:30.326193 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b884a480-769b-4f9e-8542-70e4ee3f4db4 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:30.329946 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b884a480-769b-4f9e-8542-70e4ee3f4db4 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:30.331535 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b884a480-769b-4f9e-8542-70e4ee3f4db4 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:30.334592 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b884a480-769b-4f9e-8542-70e4ee3f4db4 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:30.777692 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-b688246d-b4fd-4b89-8f2a-d7a42c9b62af tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:30.781148 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-b688246d-b4fd-4b89-8f2a-d7a42c9b62af tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] [instance: 3a8c9525-0e7d-40f7-861f-e59324e08a1a] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:30.809834 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b688246d-b4fd-4b89-8f2a-d7a42c9b62af tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:30.820156 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b688246d-b4fd-4b89-8f2a-d7a42c9b62af tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:30.822022 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b688246d-b4fd-4b89-8f2a-d7a42c9b62af tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:30.827766 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b688246d-b4fd-4b89-8f2a-d7a42c9b62af tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:30.831774 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b688246d-b4fd-4b89-8f2a-d7a42c9b62af tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:30.834318 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b688246d-b4fd-4b89-8f2a-d7a42c9b62af tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:31.030669 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-b688246d-b4fd-4b89-8f2a-d7a42c9b62af tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62897a3ee86d4dbbae38e801ad31ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca17bd7984241b1bbca7854ceb9440b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:31.057217 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-b688246d-b4fd-4b89-8f2a-d7a42c9b62af tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] 10.222.0.42 "GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a" status: 200 len: 1273 microversion: 2.1 time: 0.292366 Aug 24 07:40:31.068515 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 26/56] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:30 2022] GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a => generated 1273 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:40:31.092451 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-61ca9eb2-ce76-4d85-8515-ea0d9707fa5d tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:31.096135 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-61ca9eb2-ce76-4d85-8515-ea0d9707fa5d tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:31.126156 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-61ca9eb2-ce76-4d85-8515-ea0d9707fa5d tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:31.133644 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-61ca9eb2-ce76-4d85-8515-ea0d9707fa5d tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:31.134261 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-61ca9eb2-ce76-4d85-8515-ea0d9707fa5d tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:31.134952 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-61ca9eb2-ce76-4d85-8515-ea0d9707fa5d tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:31.140122 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-61ca9eb2-ce76-4d85-8515-ea0d9707fa5d tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:31.143775 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-61ca9eb2-ce76-4d85-8515-ea0d9707fa5d tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:31.610566 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-b884a480-769b-4f9e-8542-70e4ee3f4db4 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:31.664979 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-b884a480-769b-4f9e-8542-70e4ee3f4db4 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 200 len: 1274 microversion: 2.1 time: 1.384496 Aug 24 07:40:31.675004 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 31/57] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:30 2022] GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 1274 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:40:32.087340 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-79afb23d-b8b5-4798-ae8c-c7b14e573c18 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:32.096811 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-79afb23d-b8b5-4798-ae8c-c7b14e573c18 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] [instance: 3a8c9525-0e7d-40f7-861f-e59324e08a1a] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:32.107521 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-79afb23d-b8b5-4798-ae8c-c7b14e573c18 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:32.110556 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-79afb23d-b8b5-4798-ae8c-c7b14e573c18 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:32.112486 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-79afb23d-b8b5-4798-ae8c-c7b14e573c18 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:32.116535 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-79afb23d-b8b5-4798-ae8c-c7b14e573c18 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:32.121501 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-79afb23d-b8b5-4798-ae8c-c7b14e573c18 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:32.122440 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-79afb23d-b8b5-4798-ae8c-c7b14e573c18 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:32.329438 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-79afb23d-b8b5-4798-ae8c-c7b14e573c18 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62897a3ee86d4dbbae38e801ad31ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca17bd7984241b1bbca7854ceb9440b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:32.346051 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-79afb23d-b8b5-4798-ae8c-c7b14e573c18 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] 10.222.0.42 "GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a" status: 200 len: 1273 microversion: 2.1 time: 0.262777 Aug 24 07:40:32.347902 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 32/58] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:32 2022] GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a => generated 1273 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:40:32.686937 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-cd392b40-a2a7-4711-b948-d4183502b300 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:32.688452 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-cd392b40-a2a7-4711-b948-d4183502b300 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:32.706478 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cd392b40-a2a7-4711-b948-d4183502b300 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:32.709121 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cd392b40-a2a7-4711-b948-d4183502b300 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:32.711758 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cd392b40-a2a7-4711-b948-d4183502b300 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:32.724372 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-61ca9eb2-ce76-4d85-8515-ea0d9707fa5d tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:32.725604 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cd392b40-a2a7-4711-b948-d4183502b300 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:32.726645 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cd392b40-a2a7-4711-b948-d4183502b300 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:32.727160 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cd392b40-a2a7-4711-b948-d4183502b300 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:32.734389 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-61ca9eb2-ce76-4d85-8515-ea0d9707fa5d tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 200 len: 1362 microversion: 2.1 time: 1.665329 Aug 24 07:40:32.738968 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 27/59] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:31 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 1362 bytes in 1673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:40:33.092811 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-cd392b40-a2a7-4711-b948-d4183502b300 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:33.101807 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-cd392b40-a2a7-4711-b948-d4183502b300 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 200 len: 1280 microversion: 2.1 time: 0.419003 Aug 24 07:40:33.107444 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 33/60] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:32 2022] GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 1280 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:40:33.366983 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-b3f20caa-85e1-467a-bb97-fcf635d91f08 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:33.367691 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-b3f20caa-85e1-467a-bb97-fcf635d91f08 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] [instance: 3a8c9525-0e7d-40f7-861f-e59324e08a1a] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:33.370388 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=7 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:40:33.387083 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b3f20caa-85e1-467a-bb97-fcf635d91f08 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:33.404193 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b3f20caa-85e1-467a-bb97-fcf635d91f08 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:33.411537 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b3f20caa-85e1-467a-bb97-fcf635d91f08 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:33.413677 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b3f20caa-85e1-467a-bb97-fcf635d91f08 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:33.424705 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b3f20caa-85e1-467a-bb97-fcf635d91f08 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:33.429515 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b3f20caa-85e1-467a-bb97-fcf635d91f08 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:33.769250 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-ecea7370-9d2d-4c11-b331-64a5a88c7ced tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:33.770047 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-ecea7370-9d2d-4c11-b331-64a5a88c7ced tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:33.800771 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ecea7370-9d2d-4c11-b331-64a5a88c7ced tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:33.802584 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ecea7370-9d2d-4c11-b331-64a5a88c7ced tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:33.806396 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ecea7370-9d2d-4c11-b331-64a5a88c7ced tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:33.810683 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ecea7370-9d2d-4c11-b331-64a5a88c7ced tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:33.814077 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ecea7370-9d2d-4c11-b331-64a5a88c7ced tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:33.815195 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ecea7370-9d2d-4c11-b331-64a5a88c7ced tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:34.058140 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell0:SELECT=4 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:40:34.074651 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-b3f20caa-85e1-467a-bb97-fcf635d91f08 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62897a3ee86d4dbbae38e801ad31ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca17bd7984241b1bbca7854ceb9440b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:34.083767 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-b3f20caa-85e1-467a-bb97-fcf635d91f08 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] 10.222.0.42 "GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a" status: 200 len: 1315 microversion: 2.1 time: 0.721344 Aug 24 07:40:34.091787 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 28/61] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:33 2022] GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a => generated 1315 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:40:34.132279 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-15a3ca49-4d04-49b4-ae43-50625092906b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:34.133201 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-15a3ca49-4d04-49b4-ae43-50625092906b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:34.142278 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-15a3ca49-4d04-49b4-ae43-50625092906b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:34.145678 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-15a3ca49-4d04-49b4-ae43-50625092906b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:34.146333 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-15a3ca49-4d04-49b4-ae43-50625092906b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:34.150030 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-15a3ca49-4d04-49b4-ae43-50625092906b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:34.150767 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-15a3ca49-4d04-49b4-ae43-50625092906b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:34.151398 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-15a3ca49-4d04-49b4-ae43-50625092906b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:34.347316 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-15a3ca49-4d04-49b4-ae43-50625092906b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:34.356427 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-15a3ca49-4d04-49b4-ae43-50625092906b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 200 len: 1280 microversion: 2.1 time: 0.228650 Aug 24 07:40:34.361373 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 29/62] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:34 2022] GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 1280 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:40:35.112698 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-1534d4ff-045c-4ebf-91b4-8ef0ab2c99f4 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:35.114333 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-1534d4ff-045c-4ebf-91b4-8ef0ab2c99f4 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] [instance: 3a8c9525-0e7d-40f7-861f-e59324e08a1a] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:35.122624 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1534d4ff-045c-4ebf-91b4-8ef0ab2c99f4 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:35.123361 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1534d4ff-045c-4ebf-91b4-8ef0ab2c99f4 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:35.124018 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1534d4ff-045c-4ebf-91b4-8ef0ab2c99f4 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:35.124928 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1534d4ff-045c-4ebf-91b4-8ef0ab2c99f4 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:35.125612 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1534d4ff-045c-4ebf-91b4-8ef0ab2c99f4 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:35.126307 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1534d4ff-045c-4ebf-91b4-8ef0ab2c99f4 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:35.146243 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-ecea7370-9d2d-4c11-b331-64a5a88c7ced tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:35.155625 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-ecea7370-9d2d-4c11-b331-64a5a88c7ced tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 200 len: 1362 microversion: 2.1 time: 1.399811 Aug 24 07:40:35.159320 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 34/63] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:33 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 1362 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:40:35.381218 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-1dc166c8-26b4-4b12-9322-82ded3fda8f9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:35.382195 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-1dc166c8-26b4-4b12-9322-82ded3fda8f9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:35.396310 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1dc166c8-26b4-4b12-9322-82ded3fda8f9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:35.397472 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1dc166c8-26b4-4b12-9322-82ded3fda8f9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:35.397753 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1dc166c8-26b4-4b12-9322-82ded3fda8f9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:35.398748 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1dc166c8-26b4-4b12-9322-82ded3fda8f9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:35.399353 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1dc166c8-26b4-4b12-9322-82ded3fda8f9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:35.399998 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1dc166c8-26b4-4b12-9322-82ded3fda8f9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:35.678433 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-1dc166c8-26b4-4b12-9322-82ded3fda8f9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:35.689182 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-1dc166c8-26b4-4b12-9322-82ded3fda8f9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 200 len: 1280 microversion: 2.1 time: 0.311457 Aug 24 07:40:35.705239 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 35/64] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:35 2022] GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 1280 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:40:36.025968 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [req-85afd03f-4aea-4776-a918-f43139af5bb2 req-4e684e3b-9562-4bdf-9e4f-5a2f93df02d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63a5cb56-fccf-4fbe-be10-b637c616539c", "tag": "14fb5185-a6ab-4b56-b947-d37fd7e7479a"}]} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:40:36.061580 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-85afd03f-4aea-4776-a918-f43139af5bb2 req-4e684e3b-9562-4bdf-9e4f-5a2f93df02d4 service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:36.066516 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-85afd03f-4aea-4776-a918-f43139af5bb2 req-4e684e3b-9562-4bdf-9e4f-5a2f93df02d4 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:36.066959 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-85afd03f-4aea-4776-a918-f43139af5bb2 req-4e684e3b-9562-4bdf-9e4f-5a2f93df02d4 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:36.118028 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.compute.server_external_events [req-85afd03f-4aea-4776-a918-f43139af5bb2 req-4e684e3b-9562-4bdf-9e4f-5a2f93df02d4 service nova] Creating event network-changed:14fb5185-a6ab-4b56-b947-d37fd7e7479a for instance 63a5cb56-fccf-4fbe-be10-b637c616539c on hv-cinder-85427 Aug 24 07:40:36.118726 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-85afd03f-4aea-4776-a918-f43139af5bb2 req-4e684e3b-9562-4bdf-9e4f-5a2f93df02d4 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127114) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 07:40:36.119114 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-85afd03f-4aea-4776-a918-f43139af5bb2 req-4e684e3b-9562-4bdf-9e4f-5a2f93df02d4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127114) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 07:40:36.124755 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-99810bbc-ef56-41ed-86d3-9f55521ec70d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:36.125816 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-99810bbc-ef56-41ed-86d3-9f55521ec70d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:36.126261 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-99810bbc-ef56-41ed-86d3-9f55521ec70d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:36.128522 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-99810bbc-ef56-41ed-86d3-9f55521ec70d None None] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:36.129519 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-99810bbc-ef56-41ed-86d3-9f55521ec70d None None] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:36.132167 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-99810bbc-ef56-41ed-86d3-9f55521ec70d None None] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:36.160681 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.compute.rpcapi [None req-99810bbc-ef56-41ed-86d3-9f55521ec70d None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 07:40:36.162250 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-99810bbc-ef56-41ed-86d3-9f55521ec70d None None] Releasing lock "compute-rpcapi-router" {{(pid=127114) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 07:40:36.198858 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-99810bbc-ef56-41ed-86d3-9f55521ec70d None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.490334 Aug 24 07:40:36.200107 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 36/65] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:40:36.206213 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-8b8f591c-cdf0-4fb1-9cc1-eef003163daa tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:36.206938 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-8b8f591c-cdf0-4fb1-9cc1-eef003163daa tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:36.230831 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8b8f591c-cdf0-4fb1-9cc1-eef003163daa tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:36.235467 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8b8f591c-cdf0-4fb1-9cc1-eef003163daa tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:36.235940 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8b8f591c-cdf0-4fb1-9cc1-eef003163daa tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:36.236694 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8b8f591c-cdf0-4fb1-9cc1-eef003163daa tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:36.237160 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8b8f591c-cdf0-4fb1-9cc1-eef003163daa tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:36.237586 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8b8f591c-cdf0-4fb1-9cc1-eef003163daa tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:36.508020 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-1534d4ff-045c-4ebf-91b4-8ef0ab2c99f4 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62897a3ee86d4dbbae38e801ad31ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca17bd7984241b1bbca7854ceb9440b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:36.516189 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-1534d4ff-045c-4ebf-91b4-8ef0ab2c99f4 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] 10.222.0.42 "GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a" status: 200 len: 1315 microversion: 2.1 time: 1.407667 Aug 24 07:40:36.536059 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 30/66] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:35 2022] GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a => generated 1315 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:40:36.907384 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell0:SELECT=22 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:40:37.011150 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-8b8f591c-cdf0-4fb1-9cc1-eef003163daa tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:37.024202 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-8b8f591c-cdf0-4fb1-9cc1-eef003163daa tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 200 len: 1362 microversion: 2.1 time: 0.822657 Aug 24 07:40:37.029356 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 37/67] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:36 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 1362 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:40:37.049632 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-e5e88a7b-21ae-4ce2-a825-5e812e700150 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:37.050661 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-e5e88a7b-21ae-4ce2-a825-5e812e700150 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:37.068548 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e5e88a7b-21ae-4ce2-a825-5e812e700150 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:37.069460 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e5e88a7b-21ae-4ce2-a825-5e812e700150 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:37.070196 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e5e88a7b-21ae-4ce2-a825-5e812e700150 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:37.072004 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e5e88a7b-21ae-4ce2-a825-5e812e700150 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:37.074719 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e5e88a7b-21ae-4ce2-a825-5e812e700150 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:37.075360 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e5e88a7b-21ae-4ce2-a825-5e812e700150 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:37.345051 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [req-ce64babb-9dc2-4692-bb02-b58a4c555db0 req-dff8f4ec-f4c7-4a8f-986d-a4b0dc96a531 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2efe00bb-3dbb-42d6-82ac-4f1045ec5f33", "tag": "7f4ca84b-7881-415a-92f9-9842d6f229c4"}]} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:40:37.370620 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-ce64babb-9dc2-4692-bb02-b58a4c555db0 req-dff8f4ec-f4c7-4a8f-986d-a4b0dc96a531 service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:37.377060 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-ce64babb-9dc2-4692-bb02-b58a4c555db0 req-dff8f4ec-f4c7-4a8f-986d-a4b0dc96a531 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:37.380726 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-ce64babb-9dc2-4692-bb02-b58a4c555db0 req-dff8f4ec-f4c7-4a8f-986d-a4b0dc96a531 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:37.452529 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.compute.server_external_events [req-ce64babb-9dc2-4692-bb02-b58a4c555db0 req-dff8f4ec-f4c7-4a8f-986d-a4b0dc96a531 service nova] Creating event network-changed:7f4ca84b-7881-415a-92f9-9842d6f229c4 for instance 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 on hv-cinder-85427 Aug 24 07:40:37.454447 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-ce64babb-9dc2-4692-bb02-b58a4c555db0 req-dff8f4ec-f4c7-4a8f-986d-a4b0dc96a531 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127113) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 07:40:37.455030 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-ce64babb-9dc2-4692-bb02-b58a4c555db0 req-dff8f4ec-f4c7-4a8f-986d-a4b0dc96a531 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127113) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 07:40:37.456687 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-017425ab-37d7-435d-ab55-3fc3ca323ce8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:37.457544 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-017425ab-37d7-435d-ab55-3fc3ca323ce8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:37.458255 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-017425ab-37d7-435d-ab55-3fc3ca323ce8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:37.459282 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-017425ab-37d7-435d-ab55-3fc3ca323ce8 None None] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:37.460210 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-017425ab-37d7-435d-ab55-3fc3ca323ce8 None None] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:37.460786 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-017425ab-37d7-435d-ab55-3fc3ca323ce8 None None] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:37.471324 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.compute.rpcapi [None req-017425ab-37d7-435d-ab55-3fc3ca323ce8 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 07:40:37.472438 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-017425ab-37d7-435d-ab55-3fc3ca323ce8 None None] Releasing lock "compute-rpcapi-router" {{(pid=127113) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 07:40:37.507747 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-017425ab-37d7-435d-ab55-3fc3ca323ce8 None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.970276 Aug 24 07:40:37.509290 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 31/68] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:40:37.549058 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-f3b4b9f8-bdfd-479a-8404-11fce9a37cc3 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:37.549847 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-f3b4b9f8-bdfd-479a-8404-11fce9a37cc3 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] [instance: 3a8c9525-0e7d-40f7-861f-e59324e08a1a] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:37.579389 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f3b4b9f8-bdfd-479a-8404-11fce9a37cc3 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:37.579915 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f3b4b9f8-bdfd-479a-8404-11fce9a37cc3 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:37.580358 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f3b4b9f8-bdfd-479a-8404-11fce9a37cc3 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:37.581315 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f3b4b9f8-bdfd-479a-8404-11fce9a37cc3 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:37.588331 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f3b4b9f8-bdfd-479a-8404-11fce9a37cc3 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:37.588893 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f3b4b9f8-bdfd-479a-8404-11fce9a37cc3 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:37.840110 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell0:SELECT=22 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:40:37.874164 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-e5e88a7b-21ae-4ce2-a825-5e812e700150 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:37.888724 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-e5e88a7b-21ae-4ce2-a825-5e812e700150 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 200 len: 1322 microversion: 2.1 time: 0.853948 Aug 24 07:40:37.910839 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 38/69] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:37 2022] GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 1322 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:40:37.979629 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-f3b4b9f8-bdfd-479a-8404-11fce9a37cc3 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62897a3ee86d4dbbae38e801ad31ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca17bd7984241b1bbca7854ceb9440b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:37.992098 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-f3b4b9f8-bdfd-479a-8404-11fce9a37cc3 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] 10.222.0.42 "GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a" status: 200 len: 1315 microversion: 2.1 time: 0.453189 Aug 24 07:40:38.007482 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 32/70] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:37 2022] GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a => generated 1315 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:40:38.055033 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-c1bc7978-f707-4628-a3bc-5344644f1e34 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:38.055652 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-c1bc7978-f707-4628-a3bc-5344644f1e34 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:38.066180 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c1bc7978-f707-4628-a3bc-5344644f1e34 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:38.066678 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c1bc7978-f707-4628-a3bc-5344644f1e34 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:38.073528 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c1bc7978-f707-4628-a3bc-5344644f1e34 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:38.074298 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c1bc7978-f707-4628-a3bc-5344644f1e34 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:38.075019 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c1bc7978-f707-4628-a3bc-5344644f1e34 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:38.075630 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c1bc7978-f707-4628-a3bc-5344644f1e34 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:38.381467 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-c1bc7978-f707-4628-a3bc-5344644f1e34 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:38.389569 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-c1bc7978-f707-4628-a3bc-5344644f1e34 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 200 len: 1362 microversion: 2.1 time: 0.338956 Aug 24 07:40:38.397526 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 39/71] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:38 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 1362 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:40:38.910944 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-8ccfa7f5-9b12-4955-bfcb-fdcc9bed6607 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:38.912229 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-8ccfa7f5-9b12-4955-bfcb-fdcc9bed6607 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:38.926984 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8ccfa7f5-9b12-4955-bfcb-fdcc9bed6607 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:38.928080 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8ccfa7f5-9b12-4955-bfcb-fdcc9bed6607 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:38.929592 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8ccfa7f5-9b12-4955-bfcb-fdcc9bed6607 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:38.934409 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8ccfa7f5-9b12-4955-bfcb-fdcc9bed6607 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:38.936580 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8ccfa7f5-9b12-4955-bfcb-fdcc9bed6607 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:38.937191 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8ccfa7f5-9b12-4955-bfcb-fdcc9bed6607 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:39.028116 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-4d387452-159c-4c5d-81a8-65ce31e4e1e5 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:39.028973 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-4d387452-159c-4c5d-81a8-65ce31e4e1e5 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] [instance: 3a8c9525-0e7d-40f7-861f-e59324e08a1a] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:39.046873 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4d387452-159c-4c5d-81a8-65ce31e4e1e5 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:39.049858 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4d387452-159c-4c5d-81a8-65ce31e4e1e5 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:39.052628 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4d387452-159c-4c5d-81a8-65ce31e4e1e5 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:39.054871 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4d387452-159c-4c5d-81a8-65ce31e4e1e5 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:39.056349 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4d387452-159c-4c5d-81a8-65ce31e4e1e5 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:39.058201 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4d387452-159c-4c5d-81a8-65ce31e4e1e5 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:39.497913 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-8ccfa7f5-9b12-4955-bfcb-fdcc9bed6607 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:39.509653 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-8ccfa7f5-9b12-4955-bfcb-fdcc9bed6607 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 200 len: 1322 microversion: 2.1 time: 0.603764 Aug 24 07:40:39.516546 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 33/72] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:38 2022] GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 1322 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:40:39.547076 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-0273fd05-6c80-48d9-a475-b6b136d1f2e5 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:39.548415 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-0273fd05-6c80-48d9-a475-b6b136d1f2e5 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:39.569804 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0273fd05-6c80-48d9-a475-b6b136d1f2e5 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:39.571563 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0273fd05-6c80-48d9-a475-b6b136d1f2e5 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:39.572312 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0273fd05-6c80-48d9-a475-b6b136d1f2e5 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:39.575051 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0273fd05-6c80-48d9-a475-b6b136d1f2e5 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:39.576243 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0273fd05-6c80-48d9-a475-b6b136d1f2e5 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:39.577514 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0273fd05-6c80-48d9-a475-b6b136d1f2e5 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:39.866984 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-4d387452-159c-4c5d-81a8-65ce31e4e1e5 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62897a3ee86d4dbbae38e801ad31ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca17bd7984241b1bbca7854ceb9440b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:39.876940 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-4d387452-159c-4c5d-81a8-65ce31e4e1e5 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] 10.222.0.42 "GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a" status: 200 len: 1315 microversion: 2.1 time: 0.852087 Aug 24 07:40:39.879423 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 40/73] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:39 2022] GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a => generated 1315 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:40:39.898561 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [req-39ff995b-3c39-4b51-ae8f-ff2bd72cc7fb req-9fea72ac-b6ca-478a-8f73-7c463dee20d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a8c9525-0e7d-40f7-861f-e59324e08a1a", "tag": "94be4cab-db31-4c2e-a2bf-3780a3c1ff5f"}]} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:40:39.929390 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-39ff995b-3c39-4b51-ae8f-ff2bd72cc7fb req-9fea72ac-b6ca-478a-8f73-7c463dee20d2 service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:39.930375 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-39ff995b-3c39-4b51-ae8f-ff2bd72cc7fb req-9fea72ac-b6ca-478a-8f73-7c463dee20d2 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:39.931315 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-39ff995b-3c39-4b51-ae8f-ff2bd72cc7fb req-9fea72ac-b6ca-478a-8f73-7c463dee20d2 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:39.972692 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.compute.server_external_events [req-39ff995b-3c39-4b51-ae8f-ff2bd72cc7fb req-9fea72ac-b6ca-478a-8f73-7c463dee20d2 service nova] Creating event network-changed:94be4cab-db31-4c2e-a2bf-3780a3c1ff5f for instance 3a8c9525-0e7d-40f7-861f-e59324e08a1a on hv-cinder-85427 Aug 24 07:40:39.982266 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [req-39ff995b-3c39-4b51-ae8f-ff2bd72cc7fb req-9fea72ac-b6ca-478a-8f73-7c463dee20d2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095626 Aug 24 07:40:39.985897 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 41/74] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:40:40.187126 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-0273fd05-6c80-48d9-a475-b6b136d1f2e5 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:40.200675 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-0273fd05-6c80-48d9-a475-b6b136d1f2e5 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 200 len: 1362 microversion: 2.1 time: 0.663306 Aug 24 07:40:40.211526 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 34/75] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:39 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 1362 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:40:40.509613 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [req-8d7c23df-dfeb-4764-a2f1-e38cada81e6d req-82905f1a-0547-4167-aa7d-d522c7ae9a40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b4bf55c-7b42-416d-bc13-3d3fe94a7694", "tag": "12b994e4-39af-459c-ad7b-f5e92a5abf57"}]} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:40:40.524409 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-8d7c23df-dfeb-4764-a2f1-e38cada81e6d req-82905f1a-0547-4167-aa7d-d522c7ae9a40 service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:40.524888 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-8d7c23df-dfeb-4764-a2f1-e38cada81e6d req-82905f1a-0547-4167-aa7d-d522c7ae9a40 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:40.525313 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-8d7c23df-dfeb-4764-a2f1-e38cada81e6d req-82905f1a-0547-4167-aa7d-d522c7ae9a40 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:40.540006 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-72e771ec-71b6-427f-a696-a64551340b8d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:40.540678 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-72e771ec-71b6-427f-a696-a64551340b8d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:40.566742 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-72e771ec-71b6-427f-a696-a64551340b8d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:40.568007 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-72e771ec-71b6-427f-a696-a64551340b8d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:40.570584 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-72e771ec-71b6-427f-a696-a64551340b8d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:40.592895 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-72e771ec-71b6-427f-a696-a64551340b8d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:40.593674 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-72e771ec-71b6-427f-a696-a64551340b8d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:40.598454 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-72e771ec-71b6-427f-a696-a64551340b8d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:40.614003 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.compute.server_external_events [req-8d7c23df-dfeb-4764-a2f1-e38cada81e6d req-82905f1a-0547-4167-aa7d-d522c7ae9a40 service nova] Creating event network-changed:12b994e4-39af-459c-ad7b-f5e92a5abf57 for instance 2b4bf55c-7b42-416d-bc13-3d3fe94a7694 on hv-cinder-85427 Aug 24 07:40:40.628228 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [req-8d7c23df-dfeb-4764-a2f1-e38cada81e6d req-82905f1a-0547-4167-aa7d-d522c7ae9a40 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126207 Aug 24 07:40:40.629358 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 42/76] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:40:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:40:40.907417 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-29ea0cf0-1e51-4b4b-a89d-02c5a60a1a31 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:40.909572 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-29ea0cf0-1e51-4b4b-a89d-02c5a60a1a31 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] [instance: 3a8c9525-0e7d-40f7-861f-e59324e08a1a] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:40.917473 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-29ea0cf0-1e51-4b4b-a89d-02c5a60a1a31 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:40.918304 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-29ea0cf0-1e51-4b4b-a89d-02c5a60a1a31 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:40.918893 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-29ea0cf0-1e51-4b4b-a89d-02c5a60a1a31 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:40.920118 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-29ea0cf0-1e51-4b4b-a89d-02c5a60a1a31 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:40.920876 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-29ea0cf0-1e51-4b4b-a89d-02c5a60a1a31 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:40.922791 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-29ea0cf0-1e51-4b4b-a89d-02c5a60a1a31 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:41.097819 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-29ea0cf0-1e51-4b4b-a89d-02c5a60a1a31 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62897a3ee86d4dbbae38e801ad31ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca17bd7984241b1bbca7854ceb9440b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:41.110797 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-29ea0cf0-1e51-4b4b-a89d-02c5a60a1a31 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] 10.222.0.42 "GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a" status: 200 len: 1315 microversion: 2.1 time: 0.208261 Aug 24 07:40:41.112077 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 43/77] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:40 2022] GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:40:41.159831 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-72e771ec-71b6-427f-a696-a64551340b8d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:41.168232 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-72e771ec-71b6-427f-a696-a64551340b8d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 200 len: 1322 microversion: 2.1 time: 0.632500 Aug 24 07:40:41.169044 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 35/78] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:40 2022] GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 1322 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:40:41.234869 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-74a81eb5-4242-4a1a-942c-e19e456a9902 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:41.235634 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-74a81eb5-4242-4a1a-942c-e19e456a9902 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:41.242153 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-74a81eb5-4242-4a1a-942c-e19e456a9902 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:41.242635 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-74a81eb5-4242-4a1a-942c-e19e456a9902 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:41.243209 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-74a81eb5-4242-4a1a-942c-e19e456a9902 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:41.243904 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-74a81eb5-4242-4a1a-942c-e19e456a9902 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:41.244391 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-74a81eb5-4242-4a1a-942c-e19e456a9902 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:41.244780 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-74a81eb5-4242-4a1a-942c-e19e456a9902 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:41.404616 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-74a81eb5-4242-4a1a-942c-e19e456a9902 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:41.413303 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-74a81eb5-4242-4a1a-942c-e19e456a9902 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 200 len: 1362 microversion: 2.1 time: 0.185165 Aug 24 07:40:41.414365 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 44/79] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:41 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:40:42.134272 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-8fec512e-0dbe-44f2-bbb4-272386602ead tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:42.134983 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-8fec512e-0dbe-44f2-bbb4-272386602ead tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] [instance: 3a8c9525-0e7d-40f7-861f-e59324e08a1a] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:42.141587 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8fec512e-0dbe-44f2-bbb4-272386602ead tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:42.142268 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8fec512e-0dbe-44f2-bbb4-272386602ead tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:42.142886 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8fec512e-0dbe-44f2-bbb4-272386602ead tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:42.144068 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8fec512e-0dbe-44f2-bbb4-272386602ead tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:42.144733 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8fec512e-0dbe-44f2-bbb4-272386602ead tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:42.145403 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8fec512e-0dbe-44f2-bbb4-272386602ead tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:42.189653 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-c296fbce-bc1f-46a1-b9fd-66e0f8915f86 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:42.190267 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-c296fbce-bc1f-46a1-b9fd-66e0f8915f86 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:42.197141 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c296fbce-bc1f-46a1-b9fd-66e0f8915f86 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:42.197632 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c296fbce-bc1f-46a1-b9fd-66e0f8915f86 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:42.198073 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c296fbce-bc1f-46a1-b9fd-66e0f8915f86 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:42.202907 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c296fbce-bc1f-46a1-b9fd-66e0f8915f86 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:42.204253 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c296fbce-bc1f-46a1-b9fd-66e0f8915f86 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:42.206441 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c296fbce-bc1f-46a1-b9fd-66e0f8915f86 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:42.242469 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell1:SELECT=100 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:40:42.337178 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-8fec512e-0dbe-44f2-bbb4-272386602ead tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62897a3ee86d4dbbae38e801ad31ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca17bd7984241b1bbca7854ceb9440b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:42.346385 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-8fec512e-0dbe-44f2-bbb4-272386602ead tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] 10.222.0.42 "GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a" status: 200 len: 1315 microversion: 2.1 time: 0.217426 Aug 24 07:40:42.348211 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 36/80] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:42 2022] GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:40:42.394201 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-c296fbce-bc1f-46a1-b9fd-66e0f8915f86 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:42.402185 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-c296fbce-bc1f-46a1-b9fd-66e0f8915f86 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 200 len: 1322 microversion: 2.1 time: 0.216840 Aug 24 07:40:42.402771 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 45/81] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:42 2022] GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:40:42.436520 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-df2a87d0-2da8-44d4-8b04-4397aa86f4df tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:42.437230 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-df2a87d0-2da8-44d4-8b04-4397aa86f4df tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:42.444865 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-df2a87d0-2da8-44d4-8b04-4397aa86f4df tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:42.445353 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-df2a87d0-2da8-44d4-8b04-4397aa86f4df tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:42.445786 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-df2a87d0-2da8-44d4-8b04-4397aa86f4df tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:42.446486 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-df2a87d0-2da8-44d4-8b04-4397aa86f4df tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:42.446967 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-df2a87d0-2da8-44d4-8b04-4397aa86f4df tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:42.447390 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-df2a87d0-2da8-44d4-8b04-4397aa86f4df tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:42.455043 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell1:SELECT=100 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:40:42.800462 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-df2a87d0-2da8-44d4-8b04-4397aa86f4df tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:42.810599 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-df2a87d0-2da8-44d4-8b04-4397aa86f4df tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 200 len: 1362 microversion: 2.1 time: 0.379877 Aug 24 07:40:42.811939 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 37/82] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:42 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 1362 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:40:43.368522 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-b9fe5201-c1c8-4f9c-8923-824630929153 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:43.369142 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-b9fe5201-c1c8-4f9c-8923-824630929153 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] [instance: 3a8c9525-0e7d-40f7-861f-e59324e08a1a] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:43.371016 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:40:43.378042 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b9fe5201-c1c8-4f9c-8923-824630929153 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:43.378625 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b9fe5201-c1c8-4f9c-8923-824630929153 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:43.378984 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b9fe5201-c1c8-4f9c-8923-824630929153 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:43.379688 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b9fe5201-c1c8-4f9c-8923-824630929153 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:43.380188 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b9fe5201-c1c8-4f9c-8923-824630929153 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:43.380607 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b9fe5201-c1c8-4f9c-8923-824630929153 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:43.424637 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-d87fb965-2f5e-4aca-9ca9-c73606bc00de tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:43.425286 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-d87fb965-2f5e-4aca-9ca9-c73606bc00de tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:43.438721 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d87fb965-2f5e-4aca-9ca9-c73606bc00de tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:43.439231 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d87fb965-2f5e-4aca-9ca9-c73606bc00de tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:43.439638 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d87fb965-2f5e-4aca-9ca9-c73606bc00de tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:43.443910 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d87fb965-2f5e-4aca-9ca9-c73606bc00de tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:43.444522 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d87fb965-2f5e-4aca-9ca9-c73606bc00de tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:43.447420 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d87fb965-2f5e-4aca-9ca9-c73606bc00de tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:43.627850 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-b9fe5201-c1c8-4f9c-8923-824630929153 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62897a3ee86d4dbbae38e801ad31ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca17bd7984241b1bbca7854ceb9440b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:43.659940 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-b9fe5201-c1c8-4f9c-8923-824630929153 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] 10.222.0.42 "GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a" status: 200 len: 1315 microversion: 2.1 time: 0.293905 Aug 24 07:40:43.662879 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 46/83] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:43 2022] GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a => generated 1315 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:40:43.837474 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-db13b1b4-994b-4b83-9bf1-07c875e07db3 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:43.838108 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-db13b1b4-994b-4b83-9bf1-07c875e07db3 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:43.849574 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-db13b1b4-994b-4b83-9bf1-07c875e07db3 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:43.850335 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-db13b1b4-994b-4b83-9bf1-07c875e07db3 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:43.850982 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-db13b1b4-994b-4b83-9bf1-07c875e07db3 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:43.851931 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-db13b1b4-994b-4b83-9bf1-07c875e07db3 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:43.852534 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-db13b1b4-994b-4b83-9bf1-07c875e07db3 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:43.853553 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-db13b1b4-994b-4b83-9bf1-07c875e07db3 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:43.945521 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-d87fb965-2f5e-4aca-9ca9-c73606bc00de tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:43.951129 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-d87fb965-2f5e-4aca-9ca9-c73606bc00de tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 200 len: 1322 microversion: 2.1 time: 0.531017 Aug 24 07:40:43.951708 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 38/84] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:43 2022] GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 1322 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:40:44.032328 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-db13b1b4-994b-4b83-9bf1-07c875e07db3 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:44.046122 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-db13b1b4-994b-4b83-9bf1-07c875e07db3 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 200 len: 1362 microversion: 2.1 time: 0.213739 Aug 24 07:40:44.047080 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 47/85] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:43 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 1362 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:40:44.688794 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-30823a32-6ed8-4361-964f-a8a53ae188e6 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:44.690159 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-30823a32-6ed8-4361-964f-a8a53ae188e6 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] [instance: 3a8c9525-0e7d-40f7-861f-e59324e08a1a] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:44.713853 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-30823a32-6ed8-4361-964f-a8a53ae188e6 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:44.715095 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-30823a32-6ed8-4361-964f-a8a53ae188e6 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:44.735246 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-30823a32-6ed8-4361-964f-a8a53ae188e6 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:44.736048 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-30823a32-6ed8-4361-964f-a8a53ae188e6 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:44.736522 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-30823a32-6ed8-4361-964f-a8a53ae188e6 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:44.757912 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-30823a32-6ed8-4361-964f-a8a53ae188e6 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:44.971796 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-e212a6a0-5e5f-4ea6-980c-bde0f599aa27 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:44.973058 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-e212a6a0-5e5f-4ea6-980c-bde0f599aa27 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:44.992004 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e212a6a0-5e5f-4ea6-980c-bde0f599aa27 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:44.993307 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e212a6a0-5e5f-4ea6-980c-bde0f599aa27 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:44.994938 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e212a6a0-5e5f-4ea6-980c-bde0f599aa27 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:44.996057 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e212a6a0-5e5f-4ea6-980c-bde0f599aa27 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:44.996829 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e212a6a0-5e5f-4ea6-980c-bde0f599aa27 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:44.997422 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e212a6a0-5e5f-4ea6-980c-bde0f599aa27 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:45.360260 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-e212a6a0-5e5f-4ea6-980c-bde0f599aa27 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:45.372642 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-e212a6a0-5e5f-4ea6-980c-bde0f599aa27 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 200 len: 1322 microversion: 2.1 time: 0.402821 Aug 24 07:40:45.372763 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 48/86] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:44 2022] GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 1322 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:40:45.378351 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-57fed376-6afd-47be-9e1f-3fdbdeb9392f tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:45.379425 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-57fed376-6afd-47be-9e1f-3fdbdeb9392f tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:45.390507 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-57fed376-6afd-47be-9e1f-3fdbdeb9392f tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:45.390507 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-57fed376-6afd-47be-9e1f-3fdbdeb9392f tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:45.390507 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-57fed376-6afd-47be-9e1f-3fdbdeb9392f tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:45.390507 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-57fed376-6afd-47be-9e1f-3fdbdeb9392f tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:45.391611 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-57fed376-6afd-47be-9e1f-3fdbdeb9392f tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:45.391611 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-57fed376-6afd-47be-9e1f-3fdbdeb9392f tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:45.416370 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-30823a32-6ed8-4361-964f-a8a53ae188e6 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62897a3ee86d4dbbae38e801ad31ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca17bd7984241b1bbca7854ceb9440b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:45.433154 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-30823a32-6ed8-4361-964f-a8a53ae188e6 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] 10.222.0.42 "GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a" status: 200 len: 1315 microversion: 2.1 time: 0.749111 Aug 24 07:40:45.434228 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 39/87] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:44 2022] GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a => generated 1315 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:40:45.618145 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-57fed376-6afd-47be-9e1f-3fdbdeb9392f tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:45.626679 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-57fed376-6afd-47be-9e1f-3fdbdeb9392f tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 200 len: 1362 microversion: 2.1 time: 0.252969 Aug 24 07:40:45.636717 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 49/88] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:45 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 1362 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:40:46.393083 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-f6a2a3b2-82bf-4da3-8680-7c64f3a51ee3 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:46.394623 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-f6a2a3b2-82bf-4da3-8680-7c64f3a51ee3 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:46.401316 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f6a2a3b2-82bf-4da3-8680-7c64f3a51ee3 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:46.402241 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f6a2a3b2-82bf-4da3-8680-7c64f3a51ee3 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:46.402999 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f6a2a3b2-82bf-4da3-8680-7c64f3a51ee3 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:46.403847 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f6a2a3b2-82bf-4da3-8680-7c64f3a51ee3 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:46.404898 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f6a2a3b2-82bf-4da3-8680-7c64f3a51ee3 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:46.405476 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f6a2a3b2-82bf-4da3-8680-7c64f3a51ee3 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:46.455864 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-2ae09e7c-13c9-4f04-9fdc-5a25e959ceb1 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:46.457131 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-2ae09e7c-13c9-4f04-9fdc-5a25e959ceb1 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] [instance: 3a8c9525-0e7d-40f7-861f-e59324e08a1a] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:46.460266 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell0:SELECT=6 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:40:46.482070 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2ae09e7c-13c9-4f04-9fdc-5a25e959ceb1 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:46.482560 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2ae09e7c-13c9-4f04-9fdc-5a25e959ceb1 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:46.483037 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2ae09e7c-13c9-4f04-9fdc-5a25e959ceb1 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:46.483735 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2ae09e7c-13c9-4f04-9fdc-5a25e959ceb1 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:46.484195 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2ae09e7c-13c9-4f04-9fdc-5a25e959ceb1 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:46.484616 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2ae09e7c-13c9-4f04-9fdc-5a25e959ceb1 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:46.716217 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-2ae09e7c-13c9-4f04-9fdc-5a25e959ceb1 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62897a3ee86d4dbbae38e801ad31ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca17bd7984241b1bbca7854ceb9440b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:46.726876 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-2ae09e7c-13c9-4f04-9fdc-5a25e959ceb1 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] 10.222.0.42 "GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a" status: 200 len: 1315 microversion: 2.1 time: 0.275401 Aug 24 07:40:46.742726 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 50/89] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:46 2022] GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:40:46.742726 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-305d2575-b693-4bf5-ad47-95d099f94c16 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:46.742726 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-305d2575-b693-4bf5-ad47-95d099f94c16 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:46.745391 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-305d2575-b693-4bf5-ad47-95d099f94c16 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:46.745971 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-305d2575-b693-4bf5-ad47-95d099f94c16 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:46.746544 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-305d2575-b693-4bf5-ad47-95d099f94c16 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:46.747335 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-305d2575-b693-4bf5-ad47-95d099f94c16 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:46.747845 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-305d2575-b693-4bf5-ad47-95d099f94c16 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:46.748324 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-305d2575-b693-4bf5-ad47-95d099f94c16 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:46.762483 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-f6a2a3b2-82bf-4da3-8680-7c64f3a51ee3 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:46.774552 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-f6a2a3b2-82bf-4da3-8680-7c64f3a51ee3 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 200 len: 1322 microversion: 2.1 time: 0.386327 Aug 24 07:40:46.775801 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 40/90] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:46 2022] GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 1322 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:40:46.951436 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-305d2575-b693-4bf5-ad47-95d099f94c16 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:46.970949 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-305d2575-b693-4bf5-ad47-95d099f94c16 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 200 len: 1362 microversion: 2.1 time: 0.233189 Aug 24 07:40:46.970949 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 51/91] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:46 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 1362 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:40:47.468099 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell0:SELECT=2 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:40:47.606967 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [req-092c1cba-8970-41e5-8f6b-d3202f920220 req-f69ebb6f-3058-41ed-8230-5d2ce13bd24d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63a5cb56-fccf-4fbe-be10-b637c616539c", "name": "network-vif-plugged", "status": "completed", "tag": "14fb5185-a6ab-4b56-b947-d37fd7e7479a"}]} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:40:47.614561 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-092c1cba-8970-41e5-8f6b-d3202f920220 req-f69ebb6f-3058-41ed-8230-5d2ce13bd24d service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:47.615072 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-092c1cba-8970-41e5-8f6b-d3202f920220 req-f69ebb6f-3058-41ed-8230-5d2ce13bd24d service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:47.615493 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-092c1cba-8970-41e5-8f6b-d3202f920220 req-f69ebb6f-3058-41ed-8230-5d2ce13bd24d service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:47.628255 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.compute.server_external_events [req-092c1cba-8970-41e5-8f6b-d3202f920220 req-f69ebb6f-3058-41ed-8230-5d2ce13bd24d service nova] Creating event network-vif-plugged:14fb5185-a6ab-4b56-b947-d37fd7e7479a for instance 63a5cb56-fccf-4fbe-be10-b637c616539c on hv-cinder-85427 Aug 24 07:40:47.633880 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [req-092c1cba-8970-41e5-8f6b-d3202f920220 req-f69ebb6f-3058-41ed-8230-5d2ce13bd24d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.230606 Aug 24 07:40:47.634737 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 41/92] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:40:47.753248 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-c95e6a5f-d809-4d88-a870-9a4307caa2d4 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:47.754589 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-c95e6a5f-d809-4d88-a870-9a4307caa2d4 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] [instance: 3a8c9525-0e7d-40f7-861f-e59324e08a1a] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:47.761050 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c95e6a5f-d809-4d88-a870-9a4307caa2d4 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:47.761968 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c95e6a5f-d809-4d88-a870-9a4307caa2d4 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:47.762836 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c95e6a5f-d809-4d88-a870-9a4307caa2d4 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:47.763716 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c95e6a5f-d809-4d88-a870-9a4307caa2d4 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:47.764538 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c95e6a5f-d809-4d88-a870-9a4307caa2d4 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:47.765102 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c95e6a5f-d809-4d88-a870-9a4307caa2d4 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:47.808449 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-b6d79fb1-032b-4f16-96c4-2a230c072365 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:47.809068 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-b6d79fb1-032b-4f16-96c4-2a230c072365 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:47.825747 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b6d79fb1-032b-4f16-96c4-2a230c072365 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:47.826283 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b6d79fb1-032b-4f16-96c4-2a230c072365 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:47.833138 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b6d79fb1-032b-4f16-96c4-2a230c072365 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:47.834260 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b6d79fb1-032b-4f16-96c4-2a230c072365 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:47.836725 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b6d79fb1-032b-4f16-96c4-2a230c072365 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:47.837196 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b6d79fb1-032b-4f16-96c4-2a230c072365 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:47.999048 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-c95e6a5f-d809-4d88-a870-9a4307caa2d4 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62897a3ee86d4dbbae38e801ad31ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca17bd7984241b1bbca7854ceb9440b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:48.016859 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-c95e6a5f-d809-4d88-a870-9a4307caa2d4 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] 10.222.0.42 "GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a" status: 200 len: 1315 microversion: 2.1 time: 0.266533 Aug 24 07:40:48.016859 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 52/93] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:47 2022] GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:40:48.024224 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-645bae3f-0039-46d5-a62c-59e35fb5d657 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:48.024833 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-645bae3f-0039-46d5-a62c-59e35fb5d657 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:48.034918 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-645bae3f-0039-46d5-a62c-59e35fb5d657 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:48.035419 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-645bae3f-0039-46d5-a62c-59e35fb5d657 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:48.035851 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-645bae3f-0039-46d5-a62c-59e35fb5d657 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:48.037355 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-645bae3f-0039-46d5-a62c-59e35fb5d657 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:48.037817 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-645bae3f-0039-46d5-a62c-59e35fb5d657 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:48.038463 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-645bae3f-0039-46d5-a62c-59e35fb5d657 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:48.179585 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-b6d79fb1-032b-4f16-96c4-2a230c072365 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:48.188938 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-b6d79fb1-032b-4f16-96c4-2a230c072365 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 200 len: 1322 microversion: 2.1 time: 0.394939 Aug 24 07:40:48.189482 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 42/94] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:47 2022] GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 1322 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:40:48.249321 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-645bae3f-0039-46d5-a62c-59e35fb5d657 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:48.268845 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-645bae3f-0039-46d5-a62c-59e35fb5d657 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 200 len: 1362 microversion: 2.1 time: 0.249848 Aug 24 07:40:48.270810 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 53/95] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:48 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 1362 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:40:49.038394 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-4f480a95-fc95-42b3-bf00-83650a715227 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:49.039844 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-4f480a95-fc95-42b3-bf00-83650a715227 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] [instance: 3a8c9525-0e7d-40f7-861f-e59324e08a1a] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:49.045966 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4f480a95-fc95-42b3-bf00-83650a715227 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:49.048188 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4f480a95-fc95-42b3-bf00-83650a715227 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:49.048624 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4f480a95-fc95-42b3-bf00-83650a715227 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:49.050770 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4f480a95-fc95-42b3-bf00-83650a715227 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:49.055663 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4f480a95-fc95-42b3-bf00-83650a715227 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:49.056106 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4f480a95-fc95-42b3-bf00-83650a715227 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:49.215172 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-a2c7422d-a4a8-4d54-820f-48c5378ed382 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:49.215867 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-a2c7422d-a4a8-4d54-820f-48c5378ed382 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:49.233017 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a2c7422d-a4a8-4d54-820f-48c5378ed382 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:49.239037 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a2c7422d-a4a8-4d54-820f-48c5378ed382 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:49.239812 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a2c7422d-a4a8-4d54-820f-48c5378ed382 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:49.242886 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a2c7422d-a4a8-4d54-820f-48c5378ed382 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:49.243396 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a2c7422d-a4a8-4d54-820f-48c5378ed382 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:49.243981 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a2c7422d-a4a8-4d54-820f-48c5378ed382 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:49.299695 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-4f480a95-fc95-42b3-bf00-83650a715227 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62897a3ee86d4dbbae38e801ad31ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca17bd7984241b1bbca7854ceb9440b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:49.312129 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-4f480a95-fc95-42b3-bf00-83650a715227 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] 10.222.0.42 "GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a" status: 200 len: 1315 microversion: 2.1 time: 0.277662 Aug 24 07:40:49.314479 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 43/96] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:49 2022] GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a => generated 1315 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:40:49.326221 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-d4cfef3a-87af-4fb4-80a9-9eb77b47dcc8 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:49.329380 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-d4cfef3a-87af-4fb4-80a9-9eb77b47dcc8 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:49.340356 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d4cfef3a-87af-4fb4-80a9-9eb77b47dcc8 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:49.340822 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d4cfef3a-87af-4fb4-80a9-9eb77b47dcc8 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:49.341257 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d4cfef3a-87af-4fb4-80a9-9eb77b47dcc8 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:49.343288 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d4cfef3a-87af-4fb4-80a9-9eb77b47dcc8 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:49.344894 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d4cfef3a-87af-4fb4-80a9-9eb77b47dcc8 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:49.345525 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d4cfef3a-87af-4fb4-80a9-9eb77b47dcc8 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:49.456704 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-a2c7422d-a4a8-4d54-820f-48c5378ed382 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:49.465490 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-a2c7422d-a4a8-4d54-820f-48c5378ed382 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 200 len: 1322 microversion: 2.1 time: 0.258655 Aug 24 07:40:49.477266 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 54/97] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:49 2022] GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 1322 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:40:49.518146 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-d4cfef3a-87af-4fb4-80a9-9eb77b47dcc8 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:49.531368 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-d4cfef3a-87af-4fb4-80a9-9eb77b47dcc8 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 200 len: 1362 microversion: 2.1 time: 0.213998 Aug 24 07:40:49.532509 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 44/98] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:49 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 1362 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:40:49.650039 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [req-fcdee7e3-000a-4a3c-8fd6-0c0217fa0fa4 req-7c550cb0-b699-4084-a07d-11b1a33ad58d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a8c9525-0e7d-40f7-861f-e59324e08a1a", "name": "network-vif-plugged", "status": "completed", "tag": "94be4cab-db31-4c2e-a2bf-3780a3c1ff5f"}, {"server_uuid": "2efe00bb-3dbb-42d6-82ac-4f1045ec5f33", "name": "network-vif-plugged", "status": "completed", "tag": "7f4ca84b-7881-415a-92f9-9842d6f229c4"}]} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:40:49.663183 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-fcdee7e3-000a-4a3c-8fd6-0c0217fa0fa4 req-7c550cb0-b699-4084-a07d-11b1a33ad58d service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:49.664112 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-fcdee7e3-000a-4a3c-8fd6-0c0217fa0fa4 req-7c550cb0-b699-4084-a07d-11b1a33ad58d service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:49.664766 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-fcdee7e3-000a-4a3c-8fd6-0c0217fa0fa4 req-7c550cb0-b699-4084-a07d-11b1a33ad58d service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:49.682306 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.compute.server_external_events [req-fcdee7e3-000a-4a3c-8fd6-0c0217fa0fa4 req-7c550cb0-b699-4084-a07d-11b1a33ad58d service nova] Creating event network-vif-plugged:94be4cab-db31-4c2e-a2bf-3780a3c1ff5f for instance 3a8c9525-0e7d-40f7-861f-e59324e08a1a on hv-cinder-85427 Aug 24 07:40:49.683397 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.compute.server_external_events [req-fcdee7e3-000a-4a3c-8fd6-0c0217fa0fa4 req-7c550cb0-b699-4084-a07d-11b1a33ad58d service nova] Creating event network-vif-plugged:7f4ca84b-7881-415a-92f9-9842d6f229c4 for instance 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 on hv-cinder-85427 Aug 24 07:40:49.692750 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [req-fcdee7e3-000a-4a3c-8fd6-0c0217fa0fa4 req-7c550cb0-b699-4084-a07d-11b1a33ad58d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.046492 Aug 24 07:40:49.693602 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 55/99] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:40:50.338594 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-64866518-da19-434f-9ea7-caa97fedbae7 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:50.339358 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-64866518-da19-434f-9ea7-caa97fedbae7 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] [instance: 3a8c9525-0e7d-40f7-861f-e59324e08a1a] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:50.378528 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-64866518-da19-434f-9ea7-caa97fedbae7 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:50.380222 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-64866518-da19-434f-9ea7-caa97fedbae7 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:50.381285 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-64866518-da19-434f-9ea7-caa97fedbae7 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:50.382448 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-64866518-da19-434f-9ea7-caa97fedbae7 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:50.383350 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-64866518-da19-434f-9ea7-caa97fedbae7 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:50.383937 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-64866518-da19-434f-9ea7-caa97fedbae7 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:50.490854 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-337997f2-0518-4b1a-9ac2-4f879b4548a6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:50.491760 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-337997f2-0518-4b1a-9ac2-4f879b4548a6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:50.509984 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-337997f2-0518-4b1a-9ac2-4f879b4548a6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:50.510467 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-337997f2-0518-4b1a-9ac2-4f879b4548a6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:50.510921 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-337997f2-0518-4b1a-9ac2-4f879b4548a6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:50.511612 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-337997f2-0518-4b1a-9ac2-4f879b4548a6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:50.512057 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-337997f2-0518-4b1a-9ac2-4f879b4548a6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:50.512473 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-337997f2-0518-4b1a-9ac2-4f879b4548a6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:50.621642 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-64866518-da19-434f-9ea7-caa97fedbae7 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62897a3ee86d4dbbae38e801ad31ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca17bd7984241b1bbca7854ceb9440b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:50.632753 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-64866518-da19-434f-9ea7-caa97fedbae7 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] 10.222.0.42 "GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a" status: 200 len: 1315 microversion: 2.1 time: 0.300870 Aug 24 07:40:50.633850 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 45/100] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:50 2022] GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:40:50.638712 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-6438f213-730a-4db9-b358-0e9487791e30 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:50.639305 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-6438f213-730a-4db9-b358-0e9487791e30 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:50.646442 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6438f213-730a-4db9-b358-0e9487791e30 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:50.647137 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6438f213-730a-4db9-b358-0e9487791e30 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:50.647558 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6438f213-730a-4db9-b358-0e9487791e30 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:50.648426 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6438f213-730a-4db9-b358-0e9487791e30 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:50.649017 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6438f213-730a-4db9-b358-0e9487791e30 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:50.649578 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6438f213-730a-4db9-b358-0e9487791e30 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:50.729042 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-337997f2-0518-4b1a-9ac2-4f879b4548a6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:50.740438 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-337997f2-0518-4b1a-9ac2-4f879b4548a6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 200 len: 1322 microversion: 2.1 time: 0.257223 Aug 24 07:40:50.762937 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 56/101] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:50 2022] GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 1322 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:40:50.896111 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-6438f213-730a-4db9-b358-0e9487791e30 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:50.905494 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-6438f213-730a-4db9-b358-0e9487791e30 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 200 len: 1548 microversion: 2.1 time: 0.270267 Aug 24 07:40:50.906623 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 46/102] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:50 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 1548 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:40:50.932563 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-f3051c94-71f5-447e-bbf7-ff114abe9d14 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:50.933187 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-f3051c94-71f5-447e-bbf7-ff114abe9d14 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:50.941609 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f3051c94-71f5-447e-bbf7-ff114abe9d14 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:50.942206 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f3051c94-71f5-447e-bbf7-ff114abe9d14 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:50.942679 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f3051c94-71f5-447e-bbf7-ff114abe9d14 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:50.943401 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f3051c94-71f5-447e-bbf7-ff114abe9d14 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:50.943853 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f3051c94-71f5-447e-bbf7-ff114abe9d14 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:50.944587 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f3051c94-71f5-447e-bbf7-ff114abe9d14 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:51.129579 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-f3051c94-71f5-447e-bbf7-ff114abe9d14 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.204996 Aug 24 07:40:51.130340 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 57/103] 10.222.0.42 () {58 vars in 1275 bytes} [Wed Aug 24 07:40:50 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c/os-interface => generated 284 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:40:51.657248 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-299be173-9229-4eda-b057-1251566dc9a1 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:51.658554 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-299be173-9229-4eda-b057-1251566dc9a1 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] [instance: 3a8c9525-0e7d-40f7-861f-e59324e08a1a] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:51.680383 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-299be173-9229-4eda-b057-1251566dc9a1 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:51.681140 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-299be173-9229-4eda-b057-1251566dc9a1 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:51.681736 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-299be173-9229-4eda-b057-1251566dc9a1 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:51.682604 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-299be173-9229-4eda-b057-1251566dc9a1 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:51.683235 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-299be173-9229-4eda-b057-1251566dc9a1 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:51.683801 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-299be173-9229-4eda-b057-1251566dc9a1 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:51.712049 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [req-293f3453-0416-4480-abc6-4b205f595ee6 req-d6918a94-0c9c-440a-90b4-3a8cdccb830e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b4bf55c-7b42-416d-bc13-3d3fe94a7694", "name": "network-vif-plugged", "status": "completed", "tag": "12b994e4-39af-459c-ad7b-f5e92a5abf57"}]} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:40:51.730994 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-293f3453-0416-4480-abc6-4b205f595ee6 req-d6918a94-0c9c-440a-90b4-3a8cdccb830e service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:51.732560 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-293f3453-0416-4480-abc6-4b205f595ee6 req-d6918a94-0c9c-440a-90b4-3a8cdccb830e service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:51.736711 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-293f3453-0416-4480-abc6-4b205f595ee6 req-d6918a94-0c9c-440a-90b4-3a8cdccb830e service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:51.796371 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.compute.server_external_events [req-293f3453-0416-4480-abc6-4b205f595ee6 req-d6918a94-0c9c-440a-90b4-3a8cdccb830e service nova] Creating event network-vif-plugged:12b994e4-39af-459c-ad7b-f5e92a5abf57 for instance 2b4bf55c-7b42-416d-bc13-3d3fe94a7694 on hv-cinder-85427 Aug 24 07:40:51.807858 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [req-293f3453-0416-4480-abc6-4b205f595ee6 req-d6918a94-0c9c-440a-90b4-3a8cdccb830e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099330 Aug 24 07:40:51.808736 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 58/104] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:40:51.820125 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-d73d551d-fc62-4093-afd7-b3eba6f50eb1 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:51.823182 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-d73d551d-fc62-4093-afd7-b3eba6f50eb1 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:51.834267 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d73d551d-fc62-4093-afd7-b3eba6f50eb1 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:51.834758 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d73d551d-fc62-4093-afd7-b3eba6f50eb1 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:51.835205 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d73d551d-fc62-4093-afd7-b3eba6f50eb1 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:51.835885 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d73d551d-fc62-4093-afd7-b3eba6f50eb1 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:51.836333 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d73d551d-fc62-4093-afd7-b3eba6f50eb1 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:51.839605 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d73d551d-fc62-4093-afd7-b3eba6f50eb1 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:51.984510 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-299be173-9229-4eda-b057-1251566dc9a1 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62897a3ee86d4dbbae38e801ad31ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca17bd7984241b1bbca7854ceb9440b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:51.992683 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-299be173-9229-4eda-b057-1251566dc9a1 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] 10.222.0.42 "GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a" status: 200 len: 1315 microversion: 2.1 time: 0.339751 Aug 24 07:40:51.995992 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 47/105] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:51 2022] GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a => generated 1315 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:40:52.253477 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-d73d551d-fc62-4093-afd7-b3eba6f50eb1 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:52.262636 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-d73d551d-fc62-4093-afd7-b3eba6f50eb1 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 200 len: 1322 microversion: 2.1 time: 0.452498 Aug 24 07:40:52.267896 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 59/106] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:51 2022] GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 1322 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:40:52.968303 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [req-4603d176-9dc3-4093-9a91-0e6f2f82a0e6 req-683d67f1-2fb4-4c0c-9541-70fc4d8f72c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63a5cb56-fccf-4fbe-be10-b637c616539c", "tag": "14fb5185-a6ab-4b56-b947-d37fd7e7479a"}]} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:40:52.977823 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-4603d176-9dc3-4093-9a91-0e6f2f82a0e6 req-683d67f1-2fb4-4c0c-9541-70fc4d8f72c0 service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:52.978524 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-4603d176-9dc3-4093-9a91-0e6f2f82a0e6 req-683d67f1-2fb4-4c0c-9541-70fc4d8f72c0 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:52.979073 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-4603d176-9dc3-4093-9a91-0e6f2f82a0e6 req-683d67f1-2fb4-4c0c-9541-70fc4d8f72c0 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:52.992879 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.compute.server_external_events [req-4603d176-9dc3-4093-9a91-0e6f2f82a0e6 req-683d67f1-2fb4-4c0c-9541-70fc4d8f72c0 service nova] Creating event network-changed:14fb5185-a6ab-4b56-b947-d37fd7e7479a for instance 63a5cb56-fccf-4fbe-be10-b637c616539c on hv-cinder-85427 Aug 24 07:40:52.998117 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [req-4603d176-9dc3-4093-9a91-0e6f2f82a0e6 req-683d67f1-2fb4-4c0c-9541-70fc4d8f72c0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033657 Aug 24 07:40:52.999506 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 48/107] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:40:53.026500 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-b896d379-64af-47da-8cb7-858040994812 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:53.029097 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-b896d379-64af-47da-8cb7-858040994812 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] [instance: 3a8c9525-0e7d-40f7-861f-e59324e08a1a] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:53.038245 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b896d379-64af-47da-8cb7-858040994812 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:53.038963 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b896d379-64af-47da-8cb7-858040994812 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:53.039768 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b896d379-64af-47da-8cb7-858040994812 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:53.040725 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b896d379-64af-47da-8cb7-858040994812 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:53.041406 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b896d379-64af-47da-8cb7-858040994812 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:53.041978 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b896d379-64af-47da-8cb7-858040994812 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:53.222885 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-b896d379-64af-47da-8cb7-858040994812 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62897a3ee86d4dbbae38e801ad31ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca17bd7984241b1bbca7854ceb9440b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:53.235894 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-b896d379-64af-47da-8cb7-858040994812 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] 10.222.0.42 "GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a" status: 200 len: 1315 microversion: 2.1 time: 0.219640 Aug 24 07:40:53.236946 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 60/108] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:53 2022] GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:40:53.287335 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-9aec1377-d2be-490b-99cb-6a7b3b874728 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:53.288033 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-9aec1377-d2be-490b-99cb-6a7b3b874728 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:53.294017 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9aec1377-d2be-490b-99cb-6a7b3b874728 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:53.294499 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9aec1377-d2be-490b-99cb-6a7b3b874728 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:53.294955 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9aec1377-d2be-490b-99cb-6a7b3b874728 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:53.295753 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9aec1377-d2be-490b-99cb-6a7b3b874728 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:53.296369 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9aec1377-d2be-490b-99cb-6a7b3b874728 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:53.296969 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9aec1377-d2be-490b-99cb-6a7b3b874728 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:53.601127 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-9aec1377-d2be-490b-99cb-6a7b3b874728 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:53.610417 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-9aec1377-d2be-490b-99cb-6a7b3b874728 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 200 len: 1322 microversion: 2.1 time: 0.326686 Aug 24 07:40:53.611319 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 49/109] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:53 2022] GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 1322 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:40:54.260682 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-96d3cf50-5981-4f6d-9e5d-017542f007af tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:54.261253 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-96d3cf50-5981-4f6d-9e5d-017542f007af tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] [instance: 3a8c9525-0e7d-40f7-861f-e59324e08a1a] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:54.274684 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-96d3cf50-5981-4f6d-9e5d-017542f007af tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:54.275409 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-96d3cf50-5981-4f6d-9e5d-017542f007af tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:54.276071 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-96d3cf50-5981-4f6d-9e5d-017542f007af tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:54.276990 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-96d3cf50-5981-4f6d-9e5d-017542f007af tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:54.277743 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-96d3cf50-5981-4f6d-9e5d-017542f007af tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:54.278183 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-96d3cf50-5981-4f6d-9e5d-017542f007af tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:54.486245 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-96d3cf50-5981-4f6d-9e5d-017542f007af tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62897a3ee86d4dbbae38e801ad31ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca17bd7984241b1bbca7854ceb9440b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:54.517464 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-96d3cf50-5981-4f6d-9e5d-017542f007af tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] 10.222.0.42 "GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a" status: 200 len: 1503 microversion: 2.1 time: 0.259325 Aug 24 07:40:54.518140 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 61/110] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:54 2022] GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a => generated 1503 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:40:54.635830 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-fdb01da9-f59e-4433-a28c-136c4913b93e tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:54.637240 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-fdb01da9-f59e-4433-a28c-136c4913b93e tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:54.650462 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-fdb01da9-f59e-4433-a28c-136c4913b93e tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:54.651327 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-fdb01da9-f59e-4433-a28c-136c4913b93e tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:54.652048 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-fdb01da9-f59e-4433-a28c-136c4913b93e tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:54.653449 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-fdb01da9-f59e-4433-a28c-136c4913b93e tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:54.654370 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-fdb01da9-f59e-4433-a28c-136c4913b93e tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:54.655090 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-fdb01da9-f59e-4433-a28c-136c4913b93e tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:55.012467 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-fdb01da9-f59e-4433-a28c-136c4913b93e tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:55.038877 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-fdb01da9-f59e-4433-a28c-136c4913b93e tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 200 len: 1322 microversion: 2.1 time: 0.409262 Aug 24 07:40:55.043728 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 50/111] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:54 2022] GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 1322 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:40:56.069852 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-657085a3-dc4e-4711-9e26-cf2d211b1934 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:56.070674 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-657085a3-dc4e-4711-9e26-cf2d211b1934 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:56.077774 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-657085a3-dc4e-4711-9e26-cf2d211b1934 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:56.078328 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-657085a3-dc4e-4711-9e26-cf2d211b1934 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:56.079419 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-657085a3-dc4e-4711-9e26-cf2d211b1934 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:56.080162 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-657085a3-dc4e-4711-9e26-cf2d211b1934 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:56.080696 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-657085a3-dc4e-4711-9e26-cf2d211b1934 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:56.081187 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-657085a3-dc4e-4711-9e26-cf2d211b1934 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:56.242565 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-657085a3-dc4e-4711-9e26-cf2d211b1934 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:56.251720 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-657085a3-dc4e-4711-9e26-cf2d211b1934 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 200 len: 1516 microversion: 2.1 time: 0.186186 Aug 24 07:40:56.252300 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 62/112] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:56 2022] GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 1516 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:40:56.276494 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-5bb8e3c3-6eee-446b-948c-fdbeed404744 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:40:56.279514 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-5bb8e3c3-6eee-446b-948c-fdbeed404744 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:56.292148 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5bb8e3c3-6eee-446b-948c-fdbeed404744 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:56.292648 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5bb8e3c3-6eee-446b-948c-fdbeed404744 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:56.293074 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5bb8e3c3-6eee-446b-948c-fdbeed404744 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:56.293774 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5bb8e3c3-6eee-446b-948c-fdbeed404744 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:56.294218 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5bb8e3c3-6eee-446b-948c-fdbeed404744 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:56.294634 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5bb8e3c3-6eee-446b-948c-fdbeed404744 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:56.344544 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-30d842b3-c35e-4a68-b8a2-e057064f6936 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5a161d73-19a2-4865-a0c3-9a87d86fadbf"}} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:40:56.347317 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-30d842b3-c35e-4a68-b8a2-e057064f6936 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] [instance: 3a8c9525-0e7d-40f7-861f-e59324e08a1a] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:56.353971 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-30d842b3-c35e-4a68-b8a2-e057064f6936 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:56.354667 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-30d842b3-c35e-4a68-b8a2-e057064f6936 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:56.355281 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-30d842b3-c35e-4a68-b8a2-e057064f6936 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:56.356145 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-30d842b3-c35e-4a68-b8a2-e057064f6936 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:56.356601 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-30d842b3-c35e-4a68-b8a2-e057064f6936 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:56.357164 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-30d842b3-c35e-4a68-b8a2-e057064f6936 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:56.384644 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.objects.instance [None req-5bb8e3c3-6eee-446b-948c-fdbeed404744 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lazy-loading 'flavor' on Instance uuid 2b4bf55c-7b42-416d-bc13-3d3fe94a7694 {{(pid=127113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:40:56.468311 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell1:SELECT=100 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:40:56.523627 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-5bb8e3c3-6eee-446b-948c-fdbeed404744 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "POST /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694/action" status: 200 len: 32 microversion: 2.1 time: 0.253594 Aug 24 07:40:56.524334 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 51/113] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 24 07:40:56 2022] POST /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694/action => generated 32 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 07:40:56.534638 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-d16ff112-7e50-40c7-bfb4-54757819e27d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:56.535414 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-d16ff112-7e50-40c7-bfb4-54757819e27d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:56.542009 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d16ff112-7e50-40c7-bfb4-54757819e27d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:56.542496 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d16ff112-7e50-40c7-bfb4-54757819e27d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:56.542964 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d16ff112-7e50-40c7-bfb4-54757819e27d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:56.543662 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d16ff112-7e50-40c7-bfb4-54757819e27d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:56.544115 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d16ff112-7e50-40c7-bfb4-54757819e27d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:56.544554 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d16ff112-7e50-40c7-bfb4-54757819e27d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:56.696900 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-d16ff112-7e50-40c7-bfb4-54757819e27d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:56.705471 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-d16ff112-7e50-40c7-bfb4-54757819e27d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 200 len: 1522 microversion: 2.1 time: 0.175180 Aug 24 07:40:56.706376 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 52/114] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:56 2022] GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:40:57.726633 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-d0f7f0dd-88e9-446d-9788-2afdfff1f600 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:57.727280 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-d0f7f0dd-88e9-446d-9788-2afdfff1f600 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:57.735724 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d0f7f0dd-88e9-446d-9788-2afdfff1f600 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:57.736223 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d0f7f0dd-88e9-446d-9788-2afdfff1f600 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:57.738799 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d0f7f0dd-88e9-446d-9788-2afdfff1f600 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:57.739728 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d0f7f0dd-88e9-446d-9788-2afdfff1f600 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:57.740349 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d0f7f0dd-88e9-446d-9788-2afdfff1f600 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:57.740927 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d0f7f0dd-88e9-446d-9788-2afdfff1f600 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:57.757257 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:40:57.888887 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-d0f7f0dd-88e9-446d-9788-2afdfff1f600 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:57.896744 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-d0f7f0dd-88e9-446d-9788-2afdfff1f600 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 200 len: 1522 microversion: 2.1 time: 0.174094 Aug 24 07:40:57.897339 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 53/115] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:57 2022] GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:40:58.456664 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-30d842b3-c35e-4a68-b8a2-e057064f6936 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] 10.222.0.42 "POST /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.115979 Aug 24 07:40:58.457472 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 63/116] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Aug 24 07:40:56 2022] POST /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a/os-volume_attachments => generated 194 bytes in 2118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:40:58.927808 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-f0a53126-b165-4ceb-8a8c-3c287e45b4d3 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:40:58.929421 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-f0a53126-b165-4ceb-8a8c-3c287e45b4d3 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:40:58.948462 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f0a53126-b165-4ceb-8a8c-3c287e45b4d3 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:58.949302 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f0a53126-b165-4ceb-8a8c-3c287e45b4d3 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:58.949945 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f0a53126-b165-4ceb-8a8c-3c287e45b4d3 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:58.951272 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f0a53126-b165-4ceb-8a8c-3c287e45b4d3 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:40:58.951910 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f0a53126-b165-4ceb-8a8c-3c287e45b4d3 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:40:58.952502 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f0a53126-b165-4ceb-8a8c-3c287e45b4d3 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:40:59.204914 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-f0a53126-b165-4ceb-8a8c-3c287e45b4d3 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:40:59.217579 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-f0a53126-b165-4ceb-8a8c-3c287e45b4d3 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 200 len: 1522 microversion: 2.1 time: 0.303771 Aug 24 07:40:59.231851 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 54/117] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:40:58 2022] GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 1522 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:00.240787 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-7caf3fdd-05c0-4d87-9a34-55820ce53bdb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:00.241397 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-7caf3fdd-05c0-4d87-9a34-55820ce53bdb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:00.248121 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7caf3fdd-05c0-4d87-9a34-55820ce53bdb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:00.248704 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7caf3fdd-05c0-4d87-9a34-55820ce53bdb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:00.249060 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7caf3fdd-05c0-4d87-9a34-55820ce53bdb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:00.249760 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7caf3fdd-05c0-4d87-9a34-55820ce53bdb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:00.250204 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7caf3fdd-05c0-4d87-9a34-55820ce53bdb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:00.250646 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7caf3fdd-05c0-4d87-9a34-55820ce53bdb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:00.380940 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-7caf3fdd-05c0-4d87-9a34-55820ce53bdb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:00.388488 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-7caf3fdd-05c0-4d87-9a34-55820ce53bdb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 200 len: 1522 microversion: 2.1 time: 0.152481 Aug 24 07:41:00.389050 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 64/118] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:00 2022] GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:01.420619 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-1058df7b-0b5c-4240-a29f-dd6b21bb6920 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:01.421409 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-1058df7b-0b5c-4240-a29f-dd6b21bb6920 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:01.430813 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1058df7b-0b5c-4240-a29f-dd6b21bb6920 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:01.431695 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1058df7b-0b5c-4240-a29f-dd6b21bb6920 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:01.432310 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1058df7b-0b5c-4240-a29f-dd6b21bb6920 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:01.433606 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1058df7b-0b5c-4240-a29f-dd6b21bb6920 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:01.434433 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1058df7b-0b5c-4240-a29f-dd6b21bb6920 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:01.435055 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1058df7b-0b5c-4240-a29f-dd6b21bb6920 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:01.633342 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-1058df7b-0b5c-4240-a29f-dd6b21bb6920 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:01.633342 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-1058df7b-0b5c-4240-a29f-dd6b21bb6920 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 200 len: 1522 microversion: 2.1 time: 0.212773 Aug 24 07:41:01.633342 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 55/119] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:01 2022] GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:02.653717 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-c76e0481-1de4-4668-b25d-c66283532228 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:02.655252 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-c76e0481-1de4-4668-b25d-c66283532228 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:02.665039 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c76e0481-1de4-4668-b25d-c66283532228 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:02.665966 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c76e0481-1de4-4668-b25d-c66283532228 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:02.666803 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c76e0481-1de4-4668-b25d-c66283532228 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:02.667774 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c76e0481-1de4-4668-b25d-c66283532228 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:02.668731 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c76e0481-1de4-4668-b25d-c66283532228 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:02.669484 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c76e0481-1de4-4668-b25d-c66283532228 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:02.889425 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-c76e0481-1de4-4668-b25d-c66283532228 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:02.911911 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-c76e0481-1de4-4668-b25d-c66283532228 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 200 len: 1522 microversion: 2.1 time: 0.263349 Aug 24 07:41:02.912643 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 65/120] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:02 2022] GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:03.939929 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-78b7e88a-a943-42e8-a531-7f236d7bbaa0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:03.941157 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-78b7e88a-a943-42e8-a531-7f236d7bbaa0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:03.943050 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_api:SELECT=56 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:41:03.948518 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-78b7e88a-a943-42e8-a531-7f236d7bbaa0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:03.949150 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-78b7e88a-a943-42e8-a531-7f236d7bbaa0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:03.949743 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-78b7e88a-a943-42e8-a531-7f236d7bbaa0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:03.950612 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-78b7e88a-a943-42e8-a531-7f236d7bbaa0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:03.951242 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-78b7e88a-a943-42e8-a531-7f236d7bbaa0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:03.952578 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-78b7e88a-a943-42e8-a531-7f236d7bbaa0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:04.142530 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-78b7e88a-a943-42e8-a531-7f236d7bbaa0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:04.158122 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-78b7e88a-a943-42e8-a531-7f236d7bbaa0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 200 len: 1522 microversion: 2.1 time: 0.220920 Aug 24 07:41:04.161466 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 56/121] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:03 2022] GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:41:05.181359 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-9877dbc0-256e-4879-ba1b-f5fcbbed395f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:05.182465 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-9877dbc0-256e-4879-ba1b-f5fcbbed395f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:05.189764 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9877dbc0-256e-4879-ba1b-f5fcbbed395f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:05.190244 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9877dbc0-256e-4879-ba1b-f5fcbbed395f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:05.190665 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9877dbc0-256e-4879-ba1b-f5fcbbed395f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:05.191630 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9877dbc0-256e-4879-ba1b-f5fcbbed395f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:05.192009 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9877dbc0-256e-4879-ba1b-f5fcbbed395f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:05.192436 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9877dbc0-256e-4879-ba1b-f5fcbbed395f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:05.348867 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-9877dbc0-256e-4879-ba1b-f5fcbbed395f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:05.357108 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-9877dbc0-256e-4879-ba1b-f5fcbbed395f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 200 len: 1522 microversion: 2.1 time: 0.179774 Aug 24 07:41:05.357991 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 66/122] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:05 2022] GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:06.380495 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-3e5d56ab-24cc-418f-ab49-ac8e2befbf58 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:06.381291 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-3e5d56ab-24cc-418f-ab49-ac8e2befbf58 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:06.387423 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3e5d56ab-24cc-418f-ab49-ac8e2befbf58 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:06.388063 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3e5d56ab-24cc-418f-ab49-ac8e2befbf58 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:06.388488 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3e5d56ab-24cc-418f-ab49-ac8e2befbf58 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:06.389165 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3e5d56ab-24cc-418f-ab49-ac8e2befbf58 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:06.389606 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3e5d56ab-24cc-418f-ab49-ac8e2befbf58 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:06.390019 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3e5d56ab-24cc-418f-ab49-ac8e2befbf58 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:06.559722 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-3e5d56ab-24cc-418f-ab49-ac8e2befbf58 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:06.570781 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-3e5d56ab-24cc-418f-ab49-ac8e2befbf58 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 200 len: 1522 microversion: 2.1 time: 0.193728 Aug 24 07:41:06.572806 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 57/123] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:06 2022] GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:07.318081 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-a9f4ee35-e5fb-4ced-a772-266864005a98 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:07.323281 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-a9f4ee35-e5fb-4ced-a772-266864005a98 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] [instance: 3a8c9525-0e7d-40f7-861f-e59324e08a1a] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:07.329990 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a9f4ee35-e5fb-4ced-a772-266864005a98 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:07.330468 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a9f4ee35-e5fb-4ced-a772-266864005a98 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:07.331257 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a9f4ee35-e5fb-4ced-a772-266864005a98 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:07.332042 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a9f4ee35-e5fb-4ced-a772-266864005a98 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:07.332500 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a9f4ee35-e5fb-4ced-a772-266864005a98 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:07.332913 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a9f4ee35-e5fb-4ced-a772-266864005a98 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:07.360288 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-a9f4ee35-e5fb-4ced-a772-266864005a98 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] [instance: 3a8c9525-0e7d-40f7-861f-e59324e08a1a] Going to try to terminate instance {{(pid=127114) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 07:41:07.458500 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-a9f4ee35-e5fb-4ced-a772-266864005a98 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a" status: 204 len: 0 microversion: 2.1 time: 0.143902 Aug 24 07:41:07.459212 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 67/124] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 24 07:41:07 2022] DELETE /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 07:41:07.467856 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-d7983730-0163-4bbb-b023-7c70f76d4ec6 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:07.468580 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-d7983730-0163-4bbb-b023-7c70f76d4ec6 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] [instance: 3a8c9525-0e7d-40f7-861f-e59324e08a1a] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:07.475202 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d7983730-0163-4bbb-b023-7c70f76d4ec6 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:07.475675 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d7983730-0163-4bbb-b023-7c70f76d4ec6 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:07.476110 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d7983730-0163-4bbb-b023-7c70f76d4ec6 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:07.476790 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d7983730-0163-4bbb-b023-7c70f76d4ec6 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:07.477239 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d7983730-0163-4bbb-b023-7c70f76d4ec6 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:07.477655 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d7983730-0163-4bbb-b023-7c70f76d4ec6 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:07.593080 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-afab9412-8fb9-4587-babc-5d741c135f23 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:07.593770 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-afab9412-8fb9-4587-babc-5d741c135f23 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:07.600678 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-afab9412-8fb9-4587-babc-5d741c135f23 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:07.601364 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-afab9412-8fb9-4587-babc-5d741c135f23 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:07.601988 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-afab9412-8fb9-4587-babc-5d741c135f23 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:07.602681 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-afab9412-8fb9-4587-babc-5d741c135f23 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:07.603160 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-afab9412-8fb9-4587-babc-5d741c135f23 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:07.603572 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-afab9412-8fb9-4587-babc-5d741c135f23 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:07.651068 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-d7983730-0163-4bbb-b023-7c70f76d4ec6 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62897a3ee86d4dbbae38e801ad31ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca17bd7984241b1bbca7854ceb9440b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:07.660535 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-d7983730-0163-4bbb-b023-7c70f76d4ec6 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] 10.222.0.42 "GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a" status: 200 len: 1555 microversion: 2.1 time: 0.196889 Aug 24 07:41:07.661202 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 58/125] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:07 2022] GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a => generated 1555 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:07.736946 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-afab9412-8fb9-4587-babc-5d741c135f23 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:07.745287 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-afab9412-8fb9-4587-babc-5d741c135f23 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 200 len: 1522 microversion: 2.1 time: 0.156432 Aug 24 07:41:07.746024 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 68/126] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:07 2022] GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:08.682414 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-da1b9b6e-60ad-4692-b385-5b8b9f7b9ffe tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:08.683052 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-da1b9b6e-60ad-4692-b385-5b8b9f7b9ffe tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] [instance: 3a8c9525-0e7d-40f7-861f-e59324e08a1a] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:08.689773 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-da1b9b6e-60ad-4692-b385-5b8b9f7b9ffe tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:08.690253 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-da1b9b6e-60ad-4692-b385-5b8b9f7b9ffe tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:08.690687 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-da1b9b6e-60ad-4692-b385-5b8b9f7b9ffe tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:08.691402 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-da1b9b6e-60ad-4692-b385-5b8b9f7b9ffe tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:08.691905 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-da1b9b6e-60ad-4692-b385-5b8b9f7b9ffe tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:08.692697 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-da1b9b6e-60ad-4692-b385-5b8b9f7b9ffe tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:08.767018 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-dd4e4b63-01f8-42a9-a769-df75ad8fdb1b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:08.767535 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-dd4e4b63-01f8-42a9-a769-df75ad8fdb1b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:08.779182 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-dd4e4b63-01f8-42a9-a769-df75ad8fdb1b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:08.779974 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-dd4e4b63-01f8-42a9-a769-df75ad8fdb1b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:08.780592 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-dd4e4b63-01f8-42a9-a769-df75ad8fdb1b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:08.781287 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-dd4e4b63-01f8-42a9-a769-df75ad8fdb1b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:08.781764 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-dd4e4b63-01f8-42a9-a769-df75ad8fdb1b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:08.782180 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-dd4e4b63-01f8-42a9-a769-df75ad8fdb1b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:08.829251 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-da1b9b6e-60ad-4692-b385-5b8b9f7b9ffe tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62897a3ee86d4dbbae38e801ad31ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca17bd7984241b1bbca7854ceb9440b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:08.839733 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-da1b9b6e-60ad-4692-b385-5b8b9f7b9ffe tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] 10.222.0.42 "GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a" status: 200 len: 1555 microversion: 2.1 time: 0.161263 Aug 24 07:41:08.840321 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 59/127] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:08 2022] GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:08.935447 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-dd4e4b63-01f8-42a9-a769-df75ad8fdb1b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:08.946482 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-dd4e4b63-01f8-42a9-a769-df75ad8fdb1b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 200 len: 1522 microversion: 2.1 time: 0.183329 Aug 24 07:41:08.947160 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 69/128] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:08 2022] GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:41:09.860532 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-259e5249-462e-448f-b4d1-2d923a143e79 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:09.861895 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-259e5249-462e-448f-b4d1-2d923a143e79 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] [instance: 3a8c9525-0e7d-40f7-861f-e59324e08a1a] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:09.872041 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-259e5249-462e-448f-b4d1-2d923a143e79 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:09.872770 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-259e5249-462e-448f-b4d1-2d923a143e79 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:09.873420 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-259e5249-462e-448f-b4d1-2d923a143e79 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:09.874255 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-259e5249-462e-448f-b4d1-2d923a143e79 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:09.874890 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-259e5249-462e-448f-b4d1-2d923a143e79 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:09.876184 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-259e5249-462e-448f-b4d1-2d923a143e79 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:09.968517 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-27624aa6-2ee6-4f0b-b074-84bd48db25be tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:09.969893 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-27624aa6-2ee6-4f0b-b074-84bd48db25be tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:09.979105 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-27624aa6-2ee6-4f0b-b074-84bd48db25be tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:09.979935 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-27624aa6-2ee6-4f0b-b074-84bd48db25be tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:09.980540 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-27624aa6-2ee6-4f0b-b074-84bd48db25be tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:09.981425 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-27624aa6-2ee6-4f0b-b074-84bd48db25be tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:09.982044 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-27624aa6-2ee6-4f0b-b074-84bd48db25be tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:09.982621 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-27624aa6-2ee6-4f0b-b074-84bd48db25be tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:10.131867 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-259e5249-462e-448f-b4d1-2d923a143e79 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62897a3ee86d4dbbae38e801ad31ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca17bd7984241b1bbca7854ceb9440b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:10.142808 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-259e5249-462e-448f-b4d1-2d923a143e79 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] 10.222.0.42 "GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a" status: 200 len: 1555 microversion: 2.1 time: 0.286115 Aug 24 07:41:10.143673 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 60/129] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:09 2022] GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a => generated 1555 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:10.259550 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-27624aa6-2ee6-4f0b-b074-84bd48db25be tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:10.269948 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-27624aa6-2ee6-4f0b-b074-84bd48db25be tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 200 len: 1522 microversion: 2.1 time: 0.306874 Aug 24 07:41:10.271035 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 70/130] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:09 2022] GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 1522 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:10.564462 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [req-c98a6057-8cad-42fb-8d29-b91be954cc72 req-70907c70-381b-45c5-adc4-d7086268e575 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a8c9525-0e7d-40f7-861f-e59324e08a1a", "name": "network-vif-deleted", "tag": "94be4cab-db31-4c2e-a2bf-3780a3c1ff5f"}]} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:41:10.602309 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-c98a6057-8cad-42fb-8d29-b91be954cc72 req-70907c70-381b-45c5-adc4-d7086268e575 service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:10.602912 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-c98a6057-8cad-42fb-8d29-b91be954cc72 req-70907c70-381b-45c5-adc4-d7086268e575 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:10.603569 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-c98a6057-8cad-42fb-8d29-b91be954cc72 req-70907c70-381b-45c5-adc4-d7086268e575 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:10.617215 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.compute.server_external_events [req-c98a6057-8cad-42fb-8d29-b91be954cc72 req-70907c70-381b-45c5-adc4-d7086268e575 service nova] Creating event network-vif-deleted:94be4cab-db31-4c2e-a2bf-3780a3c1ff5f for instance 3a8c9525-0e7d-40f7-861f-e59324e08a1a on hv-cinder-85427 Aug 24 07:41:10.623764 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [req-c98a6057-8cad-42fb-8d29-b91be954cc72 req-70907c70-381b-45c5-adc4-d7086268e575 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065972 Aug 24 07:41:10.624943 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 61/131] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:41:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:41:11.165097 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-6ad68412-d94a-4b11-bf37-cbe98e75935f tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:11.165888 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-6ad68412-d94a-4b11-bf37-cbe98e75935f tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] [instance: 3a8c9525-0e7d-40f7-861f-e59324e08a1a] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:11.192442 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6ad68412-d94a-4b11-bf37-cbe98e75935f tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:11.192938 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6ad68412-d94a-4b11-bf37-cbe98e75935f tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:11.193610 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6ad68412-d94a-4b11-bf37-cbe98e75935f tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:11.194453 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6ad68412-d94a-4b11-bf37-cbe98e75935f tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:11.195237 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6ad68412-d94a-4b11-bf37-cbe98e75935f tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:11.195789 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6ad68412-d94a-4b11-bf37-cbe98e75935f tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:11.291376 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-9f3ac650-2b37-4aa2-b68b-a3f5fcab514a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:11.292085 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-9f3ac650-2b37-4aa2-b68b-a3f5fcab514a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:11.300890 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9f3ac650-2b37-4aa2-b68b-a3f5fcab514a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:11.305104 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6ad68412-d94a-4b11-bf37-cbe98e75935f tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:11.305588 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6ad68412-d94a-4b11-bf37-cbe98e75935f tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:11.306022 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6ad68412-d94a-4b11-bf37-cbe98e75935f tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:11.306482 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.objects.instance [None req-6ad68412-d94a-4b11-bf37-cbe98e75935f tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lazy-loading 'fault' on Instance uuid 3a8c9525-0e7d-40f7-861f-e59324e08a1a {{(pid=127114) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:41:11.312338 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9f3ac650-2b37-4aa2-b68b-a3f5fcab514a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:11.312794 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9f3ac650-2b37-4aa2-b68b-a3f5fcab514a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:11.314089 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9f3ac650-2b37-4aa2-b68b-a3f5fcab514a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:11.314563 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9f3ac650-2b37-4aa2-b68b-a3f5fcab514a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:11.315024 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9f3ac650-2b37-4aa2-b68b-a3f5fcab514a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:11.410451 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-6ad68412-d94a-4b11-bf37-cbe98e75935f tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62897a3ee86d4dbbae38e801ad31ea07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca17bd7984241b1bbca7854ceb9440b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:11.429983 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-6ad68412-d94a-4b11-bf37-cbe98e75935f tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] 10.222.0.42 "GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a" status: 200 len: 1351 microversion: 2.1 time: 0.269740 Aug 24 07:41:11.430577 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 71/132] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:11 2022] GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a => generated 1351 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:11.561787 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-9f3ac650-2b37-4aa2-b68b-a3f5fcab514a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:11.575820 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-9f3ac650-2b37-4aa2-b68b-a3f5fcab514a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 200 len: 1522 microversion: 2.1 time: 0.288534 Aug 24 07:41:11.577229 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 62/133] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:11 2022] GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:12.456300 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-6534203a-8d56-4c68-a242-b3f6c161949c tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:12.456975 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-6534203a-8d56-4c68-a242-b3f6c161949c tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] [instance: 3a8c9525-0e7d-40f7-861f-e59324e08a1a] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:12.465019 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6534203a-8d56-4c68-a242-b3f6c161949c tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:12.465570 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6534203a-8d56-4c68-a242-b3f6c161949c tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:12.466065 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6534203a-8d56-4c68-a242-b3f6c161949c tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:12.466855 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6534203a-8d56-4c68-a242-b3f6c161949c tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:12.467513 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6534203a-8d56-4c68-a242-b3f6c161949c tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:12.468050 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6534203a-8d56-4c68-a242-b3f6c161949c tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:12.484782 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.wsgi [None req-6534203a-8d56-4c68-a242-b3f6c161949c tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] HTTP exception thrown: Instance 3a8c9525-0e7d-40f7-861f-e59324e08a1a could not be found. Aug 24 07:41:12.489351 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-6534203a-8d56-4c68-a242-b3f6c161949c tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Request method failure captured: Aug 24 07:41:12.489351 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: request: GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a HTTP/1.1 Aug 24 07:41:12.489351 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept: application/json Aug 24 07:41:12.489351 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept-Encoding: identity Aug 24 07:41:12.489351 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Connection: close Aug 24 07:41:12.489351 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Length: 0 Aug 24 07:41:12.489351 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Type: application/json Aug 24 07:41:12.489351 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Host: 10.222.0.42 Aug 24 07:41:12.489351 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Openstack-System-Scope: None Aug 24 07:41:12.489351 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: User-Agent: python-urllib3/1.26.11 Aug 24 07:41:12.489351 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Auth-Token: gAAAAABjBdXgWv-qDUNqzY50q9_tM39IrlRiIsa-fgVVIkUzkY5c-X4IPIHgJVExNek81Fuyty8hQX8nZJ0WMMlJwsoWtGqii2cZXPir9DeoTTW9yfuqU7sfuNZXDX2oywWa4ZiTtFlMH5dVvFKH6uFBuGHHH8MbkUQ2vCMqS95xxCa1ZIKFrxE Aug 24 07:41:12.489351 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Id: None Aug 24 07:41:12.489351 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Name: None Aug 24 07:41:12.489351 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Identity-Status: Confirmed Aug 24 07:41:12.489351 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Is-Admin-Project: True Aug 24 07:41:12.489351 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Id: default Aug 24 07:41:12.489351 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Name: Default Aug 24 07:41:12.489351 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Id: 7ca17bd7984241b1bbca7854ceb9440b Aug 24 07:41:12.489351 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Name: tempest-DeleteServersTestJSON-1014034922 Aug 24 07:41:12.489351 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Role: reader,member Aug 24 07:41:12.489351 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Roles: reader,member Aug 24 07:41:12.490572 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7ca17bd7984241b1bbca7854ceb9440b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7ca17bd7984241b1bbca7854ceb9440b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7ca17bd7984241b1bbca7854ceb9440b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7ca17bd7984241b1bbca7854ceb9440b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:41:12.490572 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant: tempest-DeleteServersTestJSON-1014034922 Aug 24 07:41:12.490572 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Id: 7ca17bd7984241b1bbca7854ceb9440b Aug 24 07:41:12.490572 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Name: tempest-DeleteServersTestJSON-1014034922 Aug 24 07:41:12.490572 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User: tempest-DeleteServersTestJSON-1014034922-project Aug 24 07:41:12.490572 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Id: default Aug 24 07:41:12.490572 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Name: Default Aug 24 07:41:12.490572 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Id: 62897a3ee86d4dbbae38e801ad31ea07 Aug 24 07:41:12.490572 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Name: tempest-DeleteServersTestJSON-1014034922-project Aug 24 07:41:12.490572 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: method: > Aug 24 07:41:12.490572 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: exception: Instance 3a8c9525-0e7d-40f7-861f-e59324e08a1a could not be found. Aug 24 07:41:12.490572 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: action_args: {'id': '3a8c9525-0e7d-40f7-861f-e59324e08a1a'} Aug 24 07:41:12.491804 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:41:12.491804 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:41:12.491804 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:41:12.491804 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:41:12.491804 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:41:12.491804 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:41:12.491804 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:41:12.491804 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:41:12.491804 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:41:12.491804 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:41:12.491804 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a8c9525-0e7d-40f7-861f-e59324e08a1a could not be found. Aug 24 07:41:12.491804 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:41:12.491804 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:41:12.491804 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:41:12.491804 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:41:12.491804 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:41:12.491804 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:41:12.491804 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:41:12.491804 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:41:12.491804 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:41:12.493111 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:41:12.493111 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 07:41:12.493111 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 07:41:12.493111 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:41:12.493111 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:41:12.493111 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:41:12.493111 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:41:12.493111 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a8c9525-0e7d-40f7-861f-e59324e08a1a could not be found. Aug 24 07:41:12.493111 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:41:12.493111 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:41:12.493111 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:41:12.493111 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:41:12.493111 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:41:12.493111 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:41:12.493111 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:41:12.493111 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:41:12.493111 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a8c9525-0e7d-40f7-861f-e59324e08a1a could not be found. Aug 24 07:41:12.493111 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:41:12.494318 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-6534203a-8d56-4c68-a242-b3f6c161949c tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Returning 404 to user: Instance 3a8c9525-0e7d-40f7-861f-e59324e08a1a could not be found. {{(pid=127114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:41:12.494318 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-6534203a-8d56-4c68-a242-b3f6c161949c tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] 10.222.0.42 "GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a" status: 404 len: 111 microversion: 2.1 time: 0.039006 Aug 24 07:41:12.494318 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 72/134] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:12 2022] GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:41:12.598240 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-a508087b-3da0-4da2-b621-cc5e639fdbb6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:12.599635 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-a508087b-3da0-4da2-b621-cc5e639fdbb6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:12.606104 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a508087b-3da0-4da2-b621-cc5e639fdbb6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:12.606789 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a508087b-3da0-4da2-b621-cc5e639fdbb6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:12.607221 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a508087b-3da0-4da2-b621-cc5e639fdbb6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:12.608158 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a508087b-3da0-4da2-b621-cc5e639fdbb6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:12.608763 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a508087b-3da0-4da2-b621-cc5e639fdbb6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:12.609503 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a508087b-3da0-4da2-b621-cc5e639fdbb6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:12.634716 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-adb3463f-ad84-4cdb-8765-a344c19e5e47 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:12.637601 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-adb3463f-ad84-4cdb-8765-a344c19e5e47 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] [instance: 3a8c9525-0e7d-40f7-861f-e59324e08a1a] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:12.645428 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-adb3463f-ad84-4cdb-8765-a344c19e5e47 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:12.646624 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-adb3463f-ad84-4cdb-8765-a344c19e5e47 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:12.647110 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-adb3463f-ad84-4cdb-8765-a344c19e5e47 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:12.647844 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-adb3463f-ad84-4cdb-8765-a344c19e5e47 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:12.648566 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-adb3463f-ad84-4cdb-8765-a344c19e5e47 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:12.649000 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-adb3463f-ad84-4cdb-8765-a344c19e5e47 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:12.664842 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.wsgi [None req-adb3463f-ad84-4cdb-8765-a344c19e5e47 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] HTTP exception thrown: Instance 3a8c9525-0e7d-40f7-861f-e59324e08a1a could not be found. Aug 24 07:41:12.669490 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-adb3463f-ad84-4cdb-8765-a344c19e5e47 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Request method failure captured: Aug 24 07:41:12.669490 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: request: GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a/os-volume_attachments HTTP/1.1 Aug 24 07:41:12.669490 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept: application/json Aug 24 07:41:12.669490 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept-Encoding: identity Aug 24 07:41:12.669490 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Connection: close Aug 24 07:41:12.669490 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Length: 0 Aug 24 07:41:12.669490 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Type: application/json Aug 24 07:41:12.669490 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Host: 10.222.0.42 Aug 24 07:41:12.669490 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Openstack-System-Scope: None Aug 24 07:41:12.669490 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: User-Agent: python-urllib3/1.26.11 Aug 24 07:41:12.669490 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Auth-Token: gAAAAABjBdXgWv-qDUNqzY50q9_tM39IrlRiIsa-fgVVIkUzkY5c-X4IPIHgJVExNek81Fuyty8hQX8nZJ0WMMlJwsoWtGqii2cZXPir9DeoTTW9yfuqU7sfuNZXDX2oywWa4ZiTtFlMH5dVvFKH6uFBuGHHH8MbkUQ2vCMqS95xxCa1ZIKFrxE Aug 24 07:41:12.669490 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Id: None Aug 24 07:41:12.669490 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Name: None Aug 24 07:41:12.669490 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Identity-Status: Confirmed Aug 24 07:41:12.669490 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Is-Admin-Project: True Aug 24 07:41:12.669490 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Id: default Aug 24 07:41:12.669490 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Name: Default Aug 24 07:41:12.669490 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Id: 7ca17bd7984241b1bbca7854ceb9440b Aug 24 07:41:12.669490 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Name: tempest-DeleteServersTestJSON-1014034922 Aug 24 07:41:12.669490 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Role: reader,member Aug 24 07:41:12.669490 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Roles: reader,member Aug 24 07:41:12.670899 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7ca17bd7984241b1bbca7854ceb9440b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7ca17bd7984241b1bbca7854ceb9440b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7ca17bd7984241b1bbca7854ceb9440b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7ca17bd7984241b1bbca7854ceb9440b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:41:12.670899 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant: tempest-DeleteServersTestJSON-1014034922 Aug 24 07:41:12.670899 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Id: 7ca17bd7984241b1bbca7854ceb9440b Aug 24 07:41:12.670899 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Name: tempest-DeleteServersTestJSON-1014034922 Aug 24 07:41:12.670899 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User: tempest-DeleteServersTestJSON-1014034922-project Aug 24 07:41:12.670899 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Id: default Aug 24 07:41:12.670899 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Name: Default Aug 24 07:41:12.670899 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Id: 62897a3ee86d4dbbae38e801ad31ea07 Aug 24 07:41:12.670899 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Name: tempest-DeleteServersTestJSON-1014034922-project Aug 24 07:41:12.670899 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: method: > Aug 24 07:41:12.670899 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: exception: Instance 3a8c9525-0e7d-40f7-861f-e59324e08a1a could not be found. Aug 24 07:41:12.670899 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: action_args: {'server_id': '3a8c9525-0e7d-40f7-861f-e59324e08a1a'} Aug 24 07:41:12.671662 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:41:12.671662 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:41:12.671662 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:41:12.671662 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:41:12.671662 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:41:12.671662 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:41:12.671662 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:41:12.671662 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:41:12.671662 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:41:12.671662 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:41:12.671662 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a8c9525-0e7d-40f7-861f-e59324e08a1a could not be found. Aug 24 07:41:12.671662 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:41:12.671662 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:41:12.671662 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:41:12.671662 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:41:12.671662 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:41:12.671662 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:41:12.671662 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:41:12.671662 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:41:12.671662 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:41:12.672856 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:41:12.672856 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 07:41:12.672856 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 07:41:12.672856 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 07:41:12.672856 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 07:41:12.672856 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 24 07:41:12.672856 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 24 07:41:12.672856 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:41:12.672856 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:41:12.672856 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a8c9525-0e7d-40f7-861f-e59324e08a1a could not be found. Aug 24 07:41:12.672856 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:41:12.672856 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:41:12.672856 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:41:12.672856 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:41:12.672856 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:41:12.672856 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:41:12.672856 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:41:12.672856 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:41:12.672856 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a8c9525-0e7d-40f7-861f-e59324e08a1a could not be found. Aug 24 07:41:12.672856 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:41:12.674082 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-adb3463f-ad84-4cdb-8765-a344c19e5e47 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Returning 404 to user: Instance 3a8c9525-0e7d-40f7-861f-e59324e08a1a could not be found. {{(pid=127114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:41:12.674082 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-adb3463f-ad84-4cdb-8765-a344c19e5e47 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] 10.222.0.42 "GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.043644 Aug 24 07:41:12.690525 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 73/135] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 24 07:41:12 2022] GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a/os-volume_attachments => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 07:41:12.794005 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-a508087b-3da0-4da2-b621-cc5e639fdbb6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:12.802522 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-a508087b-3da0-4da2-b621-cc5e639fdbb6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 200 len: 1522 microversion: 2.1 time: 0.209073 Aug 24 07:41:12.804051 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 63/136] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:12 2022] GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:13.824457 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-f23989aa-b9cf-45c7-ac78-b3ddb14999d3 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:13.825188 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-f23989aa-b9cf-45c7-ac78-b3ddb14999d3 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:13.827602 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:41:13.833848 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f23989aa-b9cf-45c7-ac78-b3ddb14999d3 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:13.834312 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f23989aa-b9cf-45c7-ac78-b3ddb14999d3 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:13.834766 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f23989aa-b9cf-45c7-ac78-b3ddb14999d3 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:13.835463 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f23989aa-b9cf-45c7-ac78-b3ddb14999d3 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:13.835918 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f23989aa-b9cf-45c7-ac78-b3ddb14999d3 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:13.836341 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f23989aa-b9cf-45c7-ac78-b3ddb14999d3 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:13.948418 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-a7d7643e-4fe6-4c22-ae37-2ed6b203ffb3 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:13.950093 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-a7d7643e-4fe6-4c22-ae37-2ed6b203ffb3 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] [instance: 3a8c9525-0e7d-40f7-861f-e59324e08a1a] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:13.958097 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a7d7643e-4fe6-4c22-ae37-2ed6b203ffb3 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:13.958933 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a7d7643e-4fe6-4c22-ae37-2ed6b203ffb3 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:13.960173 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a7d7643e-4fe6-4c22-ae37-2ed6b203ffb3 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:13.961171 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a7d7643e-4fe6-4c22-ae37-2ed6b203ffb3 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:13.961837 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a7d7643e-4fe6-4c22-ae37-2ed6b203ffb3 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:13.962588 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a7d7643e-4fe6-4c22-ae37-2ed6b203ffb3 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:13.980968 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.wsgi [None req-a7d7643e-4fe6-4c22-ae37-2ed6b203ffb3 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] HTTP exception thrown: Instance 3a8c9525-0e7d-40f7-861f-e59324e08a1a could not be found. Aug 24 07:41:13.986304 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-a7d7643e-4fe6-4c22-ae37-2ed6b203ffb3 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Request method failure captured: Aug 24 07:41:13.986304 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: request: DELETE /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a HTTP/1.1 Aug 24 07:41:13.986304 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept: application/json Aug 24 07:41:13.986304 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept-Encoding: identity Aug 24 07:41:13.986304 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Connection: close Aug 24 07:41:13.986304 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Length: 0 Aug 24 07:41:13.986304 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Type: application/json Aug 24 07:41:13.986304 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Host: 10.222.0.42 Aug 24 07:41:13.986304 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Openstack-System-Scope: None Aug 24 07:41:13.986304 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: User-Agent: python-urllib3/1.26.11 Aug 24 07:41:13.986304 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Auth-Token: gAAAAABjBdXgWv-qDUNqzY50q9_tM39IrlRiIsa-fgVVIkUzkY5c-X4IPIHgJVExNek81Fuyty8hQX8nZJ0WMMlJwsoWtGqii2cZXPir9DeoTTW9yfuqU7sfuNZXDX2oywWa4ZiTtFlMH5dVvFKH6uFBuGHHH8MbkUQ2vCMqS95xxCa1ZIKFrxE Aug 24 07:41:13.986304 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Id: None Aug 24 07:41:13.986304 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Name: None Aug 24 07:41:13.986304 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Identity-Status: Confirmed Aug 24 07:41:13.986304 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Is-Admin-Project: True Aug 24 07:41:13.986304 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Id: default Aug 24 07:41:13.986304 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Name: Default Aug 24 07:41:13.986304 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Id: 7ca17bd7984241b1bbca7854ceb9440b Aug 24 07:41:13.986304 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Name: tempest-DeleteServersTestJSON-1014034922 Aug 24 07:41:13.986304 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Role: reader,member Aug 24 07:41:13.986304 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Roles: reader,member Aug 24 07:41:13.987519 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7ca17bd7984241b1bbca7854ceb9440b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7ca17bd7984241b1bbca7854ceb9440b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7ca17bd7984241b1bbca7854ceb9440b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7ca17bd7984241b1bbca7854ceb9440b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:41:13.987519 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant: tempest-DeleteServersTestJSON-1014034922 Aug 24 07:41:13.987519 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Id: 7ca17bd7984241b1bbca7854ceb9440b Aug 24 07:41:13.987519 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Name: tempest-DeleteServersTestJSON-1014034922 Aug 24 07:41:13.987519 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User: tempest-DeleteServersTestJSON-1014034922-project Aug 24 07:41:13.987519 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Id: default Aug 24 07:41:13.987519 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Name: Default Aug 24 07:41:13.987519 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Id: 62897a3ee86d4dbbae38e801ad31ea07 Aug 24 07:41:13.987519 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Name: tempest-DeleteServersTestJSON-1014034922-project Aug 24 07:41:13.987519 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: method: > Aug 24 07:41:13.987519 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: exception: Instance 3a8c9525-0e7d-40f7-861f-e59324e08a1a could not be found. Aug 24 07:41:13.987519 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: action_args: {'id': '3a8c9525-0e7d-40f7-861f-e59324e08a1a'} Aug 24 07:41:13.988157 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:41:13.988157 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:41:13.988157 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:41:13.988157 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:41:13.988157 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:41:13.988157 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:41:13.988157 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:41:13.988157 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:41:13.988157 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:41:13.988157 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:41:13.988157 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a8c9525-0e7d-40f7-861f-e59324e08a1a could not be found. Aug 24 07:41:13.988157 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:41:13.988157 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:41:13.988157 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:41:13.988157 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:41:13.988157 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:41:13.988157 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:41:13.988157 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:41:13.988157 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:41:13.988157 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:41:13.989164 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:41:13.989164 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 07:41:13.989164 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 07:41:13.989164 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 07:41:13.989164 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 07:41:13.989164 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:41:13.989164 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:41:13.989164 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:41:13.989164 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:41:13.989164 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a8c9525-0e7d-40f7-861f-e59324e08a1a could not be found. Aug 24 07:41:13.989164 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:41:13.989164 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:41:13.989164 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:41:13.989164 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:41:13.989164 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:41:13.989164 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:41:13.989164 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:41:13.989164 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:41:13.989164 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a8c9525-0e7d-40f7-861f-e59324e08a1a could not be found. Aug 24 07:41:13.989164 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:41:13.990238 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-a7d7643e-4fe6-4c22-ae37-2ed6b203ffb3 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Returning 404 to user: Instance 3a8c9525-0e7d-40f7-861f-e59324e08a1a could not be found. {{(pid=127113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:41:13.990238 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-a7d7643e-4fe6-4c22-ae37-2ed6b203ffb3 tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a" status: 404 len: 111 microversion: 2.1 time: 0.043517 Aug 24 07:41:13.990362 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-f23989aa-b9cf-45c7-ac78-b3ddb14999d3 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:13.990458 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 64/137] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 24 07:41:13 2022] DELETE /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 07:41:13.996102 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-f23989aa-b9cf-45c7-ac78-b3ddb14999d3 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 200 len: 1522 microversion: 2.1 time: 0.175489 Aug 24 07:41:13.996656 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 74/138] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:13 2022] GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:13.996968 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-a189a9f9-fdf9-4e1f-a819-df043a4d51ea tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:13.997642 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-a189a9f9-fdf9-4e1f-a819-df043a4d51ea tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] [instance: 3a8c9525-0e7d-40f7-861f-e59324e08a1a] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:14.003782 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a189a9f9-fdf9-4e1f-a819-df043a4d51ea tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:14.004333 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a189a9f9-fdf9-4e1f-a819-df043a4d51ea tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:14.004771 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a189a9f9-fdf9-4e1f-a819-df043a4d51ea tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:14.005468 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a189a9f9-fdf9-4e1f-a819-df043a4d51ea tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:14.005961 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a189a9f9-fdf9-4e1f-a819-df043a4d51ea tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:14.006425 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a189a9f9-fdf9-4e1f-a819-df043a4d51ea tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:14.020627 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.wsgi [None req-a189a9f9-fdf9-4e1f-a819-df043a4d51ea tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] HTTP exception thrown: Instance 3a8c9525-0e7d-40f7-861f-e59324e08a1a could not be found. Aug 24 07:41:14.022076 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-a189a9f9-fdf9-4e1f-a819-df043a4d51ea tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Request method failure captured: Aug 24 07:41:14.022076 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: request: GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a HTTP/1.1 Aug 24 07:41:14.022076 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept: application/json Aug 24 07:41:14.022076 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept-Encoding: identity Aug 24 07:41:14.022076 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Connection: close Aug 24 07:41:14.022076 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Length: 0 Aug 24 07:41:14.022076 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Type: application/json Aug 24 07:41:14.022076 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Host: 10.222.0.42 Aug 24 07:41:14.022076 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Openstack-System-Scope: None Aug 24 07:41:14.022076 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: User-Agent: python-urllib3/1.26.11 Aug 24 07:41:14.022076 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Auth-Token: gAAAAABjBdXgWv-qDUNqzY50q9_tM39IrlRiIsa-fgVVIkUzkY5c-X4IPIHgJVExNek81Fuyty8hQX8nZJ0WMMlJwsoWtGqii2cZXPir9DeoTTW9yfuqU7sfuNZXDX2oywWa4ZiTtFlMH5dVvFKH6uFBuGHHH8MbkUQ2vCMqS95xxCa1ZIKFrxE Aug 24 07:41:14.022076 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Id: None Aug 24 07:41:14.022076 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Name: None Aug 24 07:41:14.022076 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Identity-Status: Confirmed Aug 24 07:41:14.022076 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Is-Admin-Project: True Aug 24 07:41:14.022076 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Id: default Aug 24 07:41:14.022076 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Name: Default Aug 24 07:41:14.022076 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Id: 7ca17bd7984241b1bbca7854ceb9440b Aug 24 07:41:14.022076 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Name: tempest-DeleteServersTestJSON-1014034922 Aug 24 07:41:14.022076 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Role: reader,member Aug 24 07:41:14.022076 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Roles: reader,member Aug 24 07:41:14.023493 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7ca17bd7984241b1bbca7854ceb9440b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7ca17bd7984241b1bbca7854ceb9440b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7ca17bd7984241b1bbca7854ceb9440b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7ca17bd7984241b1bbca7854ceb9440b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:41:14.023493 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant: tempest-DeleteServersTestJSON-1014034922 Aug 24 07:41:14.023493 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Id: 7ca17bd7984241b1bbca7854ceb9440b Aug 24 07:41:14.023493 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Name: tempest-DeleteServersTestJSON-1014034922 Aug 24 07:41:14.023493 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User: tempest-DeleteServersTestJSON-1014034922-project Aug 24 07:41:14.023493 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Id: default Aug 24 07:41:14.023493 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Name: Default Aug 24 07:41:14.023493 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Id: 62897a3ee86d4dbbae38e801ad31ea07 Aug 24 07:41:14.023493 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Name: tempest-DeleteServersTestJSON-1014034922-project Aug 24 07:41:14.023493 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: method: > Aug 24 07:41:14.023493 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: exception: Instance 3a8c9525-0e7d-40f7-861f-e59324e08a1a could not be found. Aug 24 07:41:14.023493 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: action_args: {'id': '3a8c9525-0e7d-40f7-861f-e59324e08a1a'} Aug 24 07:41:14.024208 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:41:14.024208 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:41:14.024208 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:41:14.024208 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:41:14.024208 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:41:14.024208 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:41:14.024208 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:41:14.024208 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:41:14.024208 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:41:14.024208 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:41:14.024208 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a8c9525-0e7d-40f7-861f-e59324e08a1a could not be found. Aug 24 07:41:14.024208 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:41:14.024208 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:41:14.024208 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:41:14.024208 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:41:14.024208 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:41:14.024208 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:41:14.024208 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:41:14.024208 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:41:14.024208 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:41:14.025496 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:41:14.025496 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 07:41:14.025496 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 07:41:14.025496 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:41:14.025496 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:41:14.025496 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:41:14.025496 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:41:14.025496 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a8c9525-0e7d-40f7-861f-e59324e08a1a could not be found. Aug 24 07:41:14.025496 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:41:14.025496 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:41:14.025496 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:41:14.025496 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:41:14.025496 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:41:14.025496 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:41:14.025496 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:41:14.025496 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:41:14.025496 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a8c9525-0e7d-40f7-861f-e59324e08a1a could not be found. Aug 24 07:41:14.025496 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:41:14.026612 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-a189a9f9-fdf9-4e1f-a819-df043a4d51ea tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] Returning 404 to user: Instance 3a8c9525-0e7d-40f7-861f-e59324e08a1a could not be found. {{(pid=127113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:41:14.026612 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-a189a9f9-fdf9-4e1f-a819-df043a4d51ea tempest-DeleteServersTestJSON-1014034922 tempest-DeleteServersTestJSON-1014034922-project] 10.222.0.42 "GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a" status: 404 len: 111 microversion: 2.1 time: 0.030878 Aug 24 07:41:14.026612 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 65/139] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:13 2022] GET /compute/v2.1/servers/3a8c9525-0e7d-40f7-861f-e59324e08a1a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 07:41:15.018758 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-b7c4d37a-b2de-430a-b4d0-030ddd42f3a5 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:15.025618 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-b7c4d37a-b2de-430a-b4d0-030ddd42f3a5 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:15.040676 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b7c4d37a-b2de-430a-b4d0-030ddd42f3a5 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:15.042270 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b7c4d37a-b2de-430a-b4d0-030ddd42f3a5 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:15.043075 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b7c4d37a-b2de-430a-b4d0-030ddd42f3a5 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:15.044008 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b7c4d37a-b2de-430a-b4d0-030ddd42f3a5 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:15.044672 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b7c4d37a-b2de-430a-b4d0-030ddd42f3a5 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:15.045371 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b7c4d37a-b2de-430a-b4d0-030ddd42f3a5 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:15.281625 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-b7c4d37a-b2de-430a-b4d0-030ddd42f3a5 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:15.299386 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-b7c4d37a-b2de-430a-b4d0-030ddd42f3a5 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 200 len: 1522 microversion: 2.1 time: 0.286135 Aug 24 07:41:15.300080 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 75/140] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:15 2022] GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 1522 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:16.321055 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-ac182093-ef39-4db9-8fa9-29a6d21a26a9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:16.322519 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-ac182093-ef39-4db9-8fa9-29a6d21a26a9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:16.331549 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ac182093-ef39-4db9-8fa9-29a6d21a26a9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:16.332438 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ac182093-ef39-4db9-8fa9-29a6d21a26a9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:16.333109 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ac182093-ef39-4db9-8fa9-29a6d21a26a9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:16.334134 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ac182093-ef39-4db9-8fa9-29a6d21a26a9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:16.334832 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ac182093-ef39-4db9-8fa9-29a6d21a26a9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:16.335515 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ac182093-ef39-4db9-8fa9-29a6d21a26a9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:16.622627 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-ac182093-ef39-4db9-8fa9-29a6d21a26a9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:16.633342 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-ac182093-ef39-4db9-8fa9-29a6d21a26a9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 200 len: 1522 microversion: 2.1 time: 0.316775 Aug 24 07:41:16.635442 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 66/141] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:16 2022] GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 1522 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:17.655631 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-82689319-7209-4667-ad4e-affb58e66e90 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:17.661011 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-82689319-7209-4667-ad4e-affb58e66e90 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:17.672182 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-82689319-7209-4667-ad4e-affb58e66e90 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:17.673198 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-82689319-7209-4667-ad4e-affb58e66e90 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:17.673628 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-82689319-7209-4667-ad4e-affb58e66e90 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:17.674315 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-82689319-7209-4667-ad4e-affb58e66e90 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:17.674786 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-82689319-7209-4667-ad4e-affb58e66e90 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:17.675224 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-82689319-7209-4667-ad4e-affb58e66e90 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:18.020222 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-82689319-7209-4667-ad4e-affb58e66e90 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:18.042794 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-82689319-7209-4667-ad4e-affb58e66e90 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 200 len: 1522 microversion: 2.1 time: 0.390819 Aug 24 07:41:18.060434 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 76/142] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:17 2022] GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 1522 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:18.346109 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-d69f08eb-00e5-4fc1-bb57-6727bb81aa10 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1165307111", "imageRef": "4358f547-a499-43f3-9c84-925d78cd73db", "flavorRef": "452", "networks": [{"uuid": "eed16aaf-1747-457e-8889-b3a6b4424d00"}]}} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:41:19.075296 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-b6657f8c-4ff8-47d6-a683-48f7abed2562 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:19.076549 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-b6657f8c-4ff8-47d6-a683-48f7abed2562 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:19.084070 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b6657f8c-4ff8-47d6-a683-48f7abed2562 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:19.084553 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b6657f8c-4ff8-47d6-a683-48f7abed2562 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:19.084980 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b6657f8c-4ff8-47d6-a683-48f7abed2562 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:19.086884 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b6657f8c-4ff8-47d6-a683-48f7abed2562 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:19.087344 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b6657f8c-4ff8-47d6-a683-48f7abed2562 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:19.087766 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b6657f8c-4ff8-47d6-a683-48f7abed2562 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:19.367645 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-b6657f8c-4ff8-47d6-a683-48f7abed2562 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:19.388841 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-b6657f8c-4ff8-47d6-a683-48f7abed2562 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 200 len: 1522 microversion: 2.1 time: 0.318218 Aug 24 07:41:19.389748 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 77/143] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:19 2022] GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 1522 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:19.914047 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.network.neutron [None req-d69f08eb-00e5-4fc1-bb57-6727bb81aa10 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] validate_networks() for [('eed16aaf-1747-457e-8889-b3a6b4424d00', None, None, None, None, None)] {{(pid=127113) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 07:41:20.326558 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.virt.hardware [None req-d69f08eb-00e5-4fc1-bb57-6727bb81aa10 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Flavor limits 0:0:0 {{(pid=127113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 07:41:20.327480 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.virt.hardware [None req-d69f08eb-00e5-4fc1-bb57-6727bb81aa10 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Image limits 0:0:0 {{(pid=127113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 07:41:20.328274 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.virt.hardware [None req-d69f08eb-00e5-4fc1-bb57-6727bb81aa10 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Flavor pref 0:0:0 {{(pid=127113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 07:41:20.329406 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.virt.hardware [None req-d69f08eb-00e5-4fc1-bb57-6727bb81aa10 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Image pref 0:0:0 {{(pid=127113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 07:41:20.329938 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.virt.hardware [None req-d69f08eb-00e5-4fc1-bb57-6727bb81aa10 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 07:41:20.339780 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d69f08eb-00e5-4fc1-bb57-6727bb81aa10 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:20.340257 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d69f08eb-00e5-4fc1-bb57-6727bb81aa10 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:20.340701 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d69f08eb-00e5-4fc1-bb57-6727bb81aa10 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:20.341568 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d69f08eb-00e5-4fc1-bb57-6727bb81aa10 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:20.342200 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d69f08eb-00e5-4fc1-bb57-6727bb81aa10 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:20.342613 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d69f08eb-00e5-4fc1-bb57-6727bb81aa10 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:20.359644 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.quota [None req-d69f08eb-00e5-4fc1-bb57-6727bb81aa10 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Getting quotas for project bf922510f54d4d40ac00486394d67a7a. Resources: {'cores', 'ram', 'instances'} {{(pid=127113) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:41:20.363851 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.quota [None req-d69f08eb-00e5-4fc1-bb57-6727bb81aa10 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Getting quotas for user 74594b3982264446b73d14bad3f46045 and project bf922510f54d4d40ac00486394d67a7a. Resources: {'cores', 'ram', 'instances'} {{(pid=127113) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:41:20.376083 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-d69f08eb-00e5-4fc1-bb57-6727bb81aa10 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Going to run 1 instances... {{(pid=127113) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 07:41:20.378878 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-d69f08eb-00e5-4fc1-bb57-6727bb81aa10 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] [instance: 7a4bf12e-c36e-425e-bd1f-181bd4326de3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4358f547-a499-43f3-9c84-925d78cd73db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127113) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 07:41:20.410419 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-ac1fae20-5175-42d5-a6fb-c3cde54adc1d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:20.411927 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-ac1fae20-5175-42d5-a6fb-c3cde54adc1d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:20.418724 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ac1fae20-5175-42d5-a6fb-c3cde54adc1d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:20.419514 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ac1fae20-5175-42d5-a6fb-c3cde54adc1d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:20.420178 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ac1fae20-5175-42d5-a6fb-c3cde54adc1d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:20.421092 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ac1fae20-5175-42d5-a6fb-c3cde54adc1d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:20.421990 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ac1fae20-5175-42d5-a6fb-c3cde54adc1d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:20.422645 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ac1fae20-5175-42d5-a6fb-c3cde54adc1d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:20.433430 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-d69f08eb-00e5-4fc1-bb57-6727bb81aa10 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.094985 Aug 24 07:41:20.442158 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 67/144] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 24 07:41:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2105 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 07:41:20.448232 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-4ccbe735-0cb8-4d75-9f34-dcbcff10c80a tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:20.449324 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-4ccbe735-0cb8-4d75-9f34-dcbcff10c80a tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] [instance: 7a4bf12e-c36e-425e-bd1f-181bd4326de3] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:20.464413 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:41:20.560594 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-4ccbe735-0cb8-4d75-9f34-dcbcff10c80a tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74594b3982264446b73d14bad3f46045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf922510f54d4d40ac00486394d67a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:20.591060 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-4ccbe735-0cb8-4d75-9f34-dcbcff10c80a tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] 10.222.0.42 "GET /compute/v2.1/servers/7a4bf12e-c36e-425e-bd1f-181bd4326de3" status: 200 len: 1219 microversion: 2.1 time: 0.129052 Aug 24 07:41:20.591724 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 68/145] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:20 2022] GET /compute/v2.1/servers/7a4bf12e-c36e-425e-bd1f-181bd4326de3 => generated 1219 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:20.646901 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-ac1fae20-5175-42d5-a6fb-c3cde54adc1d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:20.656494 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-ac1fae20-5175-42d5-a6fb-c3cde54adc1d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 200 len: 1522 microversion: 2.1 time: 0.249851 Aug 24 07:41:20.669251 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 78/146] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:20 2022] GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:41:21.621527 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-d5af5023-615f-4f3b-83f7-0ac5e25ab015 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:21.622149 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-d5af5023-615f-4f3b-83f7-0ac5e25ab015 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] [instance: 7a4bf12e-c36e-425e-bd1f-181bd4326de3] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:21.629570 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d5af5023-615f-4f3b-83f7-0ac5e25ab015 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:21.630049 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d5af5023-615f-4f3b-83f7-0ac5e25ab015 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:21.630491 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d5af5023-615f-4f3b-83f7-0ac5e25ab015 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:21.631203 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d5af5023-615f-4f3b-83f7-0ac5e25ab015 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:21.631801 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d5af5023-615f-4f3b-83f7-0ac5e25ab015 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:21.632220 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d5af5023-615f-4f3b-83f7-0ac5e25ab015 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:21.677347 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-5d329667-0254-4aa4-b825-bb8d4fea8bb3 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:21.678924 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-5d329667-0254-4aa4-b825-bb8d4fea8bb3 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:21.690131 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5d329667-0254-4aa4-b825-bb8d4fea8bb3 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:21.690963 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5d329667-0254-4aa4-b825-bb8d4fea8bb3 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:21.691879 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5d329667-0254-4aa4-b825-bb8d4fea8bb3 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:21.693065 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5d329667-0254-4aa4-b825-bb8d4fea8bb3 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:21.693876 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5d329667-0254-4aa4-b825-bb8d4fea8bb3 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:21.694507 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5d329667-0254-4aa4-b825-bb8d4fea8bb3 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:21.742734 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-d5af5023-615f-4f3b-83f7-0ac5e25ab015 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74594b3982264446b73d14bad3f46045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf922510f54d4d40ac00486394d67a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:21.766770 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-d5af5023-615f-4f3b-83f7-0ac5e25ab015 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] 10.222.0.42 "GET /compute/v2.1/servers/7a4bf12e-c36e-425e-bd1f-181bd4326de3" status: 200 len: 1271 microversion: 2.1 time: 0.149628 Aug 24 07:41:21.767392 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 69/147] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:21 2022] GET /compute/v2.1/servers/7a4bf12e-c36e-425e-bd1f-181bd4326de3 => generated 1271 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:21.931265 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-5d329667-0254-4aa4-b825-bb8d4fea8bb3 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:21.943658 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-5d329667-0254-4aa4-b825-bb8d4fea8bb3 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 200 len: 1522 microversion: 2.1 time: 0.270995 Aug 24 07:41:21.944832 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 79/148] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:21 2022] GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:22.791497 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-a065689e-7075-4f08-a3fd-20e4d087ee69 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:22.792327 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-a065689e-7075-4f08-a3fd-20e4d087ee69 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] [instance: 7a4bf12e-c36e-425e-bd1f-181bd4326de3] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:22.803826 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a065689e-7075-4f08-a3fd-20e4d087ee69 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:22.804662 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a065689e-7075-4f08-a3fd-20e4d087ee69 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:22.805249 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a065689e-7075-4f08-a3fd-20e4d087ee69 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:22.806540 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a065689e-7075-4f08-a3fd-20e4d087ee69 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:22.807603 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a065689e-7075-4f08-a3fd-20e4d087ee69 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:22.808415 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a065689e-7075-4f08-a3fd-20e4d087ee69 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:22.966433 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-e4ad1753-e447-4082-8159-45571155b323 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:22.968025 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-e4ad1753-e447-4082-8159-45571155b323 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:22.981138 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e4ad1753-e447-4082-8159-45571155b323 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:22.981870 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e4ad1753-e447-4082-8159-45571155b323 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:22.982308 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e4ad1753-e447-4082-8159-45571155b323 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:22.983076 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e4ad1753-e447-4082-8159-45571155b323 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:22.991344 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e4ad1753-e447-4082-8159-45571155b323 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:22.992134 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e4ad1753-e447-4082-8159-45571155b323 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:23.029040 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-a065689e-7075-4f08-a3fd-20e4d087ee69 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74594b3982264446b73d14bad3f46045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf922510f54d4d40ac00486394d67a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:23.038670 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-a065689e-7075-4f08-a3fd-20e4d087ee69 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] 10.222.0.42 "GET /compute/v2.1/servers/7a4bf12e-c36e-425e-bd1f-181bd4326de3" status: 200 len: 1277 microversion: 2.1 time: 0.253717 Aug 24 07:41:23.040889 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 70/149] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:22 2022] GET /compute/v2.1/servers/7a4bf12e-c36e-425e-bd1f-181bd4326de3 => generated 1277 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:23.193019 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-e4ad1753-e447-4082-8159-45571155b323 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:23.201491 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-e4ad1753-e447-4082-8159-45571155b323 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 200 len: 1522 microversion: 2.1 time: 0.240410 Aug 24 07:41:23.202069 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 80/150] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:22 2022] GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:41:24.075910 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-d23d64c0-0a84-447d-89be-df6fbdfcb5d4 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:24.079105 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-d23d64c0-0a84-447d-89be-df6fbdfcb5d4 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] [instance: 7a4bf12e-c36e-425e-bd1f-181bd4326de3] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:24.095361 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d23d64c0-0a84-447d-89be-df6fbdfcb5d4 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:24.097899 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d23d64c0-0a84-447d-89be-df6fbdfcb5d4 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:24.098685 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d23d64c0-0a84-447d-89be-df6fbdfcb5d4 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:24.102390 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d23d64c0-0a84-447d-89be-df6fbdfcb5d4 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:24.103247 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d23d64c0-0a84-447d-89be-df6fbdfcb5d4 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:24.103989 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d23d64c0-0a84-447d-89be-df6fbdfcb5d4 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:24.227642 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-6cfc2344-0bf9-4c86-9230-88e5269d3566 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:24.228959 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-6cfc2344-0bf9-4c86-9230-88e5269d3566 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:24.247460 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6cfc2344-0bf9-4c86-9230-88e5269d3566 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:24.247955 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6cfc2344-0bf9-4c86-9230-88e5269d3566 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:24.249058 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6cfc2344-0bf9-4c86-9230-88e5269d3566 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:24.249771 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6cfc2344-0bf9-4c86-9230-88e5269d3566 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:24.250354 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6cfc2344-0bf9-4c86-9230-88e5269d3566 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:24.250907 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6cfc2344-0bf9-4c86-9230-88e5269d3566 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:24.481526 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-6cfc2344-0bf9-4c86-9230-88e5269d3566 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:24.492837 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-6cfc2344-0bf9-4c86-9230-88e5269d3566 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 200 len: 1522 microversion: 2.1 time: 0.272055 Aug 24 07:41:24.495594 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-d23d64c0-0a84-447d-89be-df6fbdfcb5d4 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74594b3982264446b73d14bad3f46045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf922510f54d4d40ac00486394d67a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:24.508033 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 81/151] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:24 2022] GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 1522 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:24.510372 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-d23d64c0-0a84-447d-89be-df6fbdfcb5d4 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] 10.222.0.42 "GET /compute/v2.1/servers/7a4bf12e-c36e-425e-bd1f-181bd4326de3" status: 200 len: 1319 microversion: 2.1 time: 0.451396 Aug 24 07:41:24.510984 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 71/152] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:24 2022] GET /compute/v2.1/servers/7a4bf12e-c36e-425e-bd1f-181bd4326de3 => generated 1319 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:25.469570 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [req-07751eb3-13d2-4f41-80b7-614adf1849c7 req-2532b7e9-3aab-4618-bffc-0279aa5ed505 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a4bf12e-c36e-425e-bd1f-181bd4326de3", "tag": "51836419-0dfc-4a1a-b731-432c8a87e9fb"}]} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:41:25.495221 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-07751eb3-13d2-4f41-80b7-614adf1849c7 req-2532b7e9-3aab-4618-bffc-0279aa5ed505 service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:25.495710 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-07751eb3-13d2-4f41-80b7-614adf1849c7 req-2532b7e9-3aab-4618-bffc-0279aa5ed505 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:25.498361 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-07751eb3-13d2-4f41-80b7-614adf1849c7 req-2532b7e9-3aab-4618-bffc-0279aa5ed505 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:25.518526 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-c844db0c-e36a-4b08-92b2-3e0f92e7b18a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:25.519208 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-c844db0c-e36a-4b08-92b2-3e0f92e7b18a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:25.532748 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.compute.server_external_events [req-07751eb3-13d2-4f41-80b7-614adf1849c7 req-2532b7e9-3aab-4618-bffc-0279aa5ed505 service nova] Creating event network-changed:51836419-0dfc-4a1a-b731-432c8a87e9fb for instance 7a4bf12e-c36e-425e-bd1f-181bd4326de3 on hv-cinder-85427 Aug 24 07:41:25.537552 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c844db0c-e36a-4b08-92b2-3e0f92e7b18a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:25.540792 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c844db0c-e36a-4b08-92b2-3e0f92e7b18a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:25.543863 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c844db0c-e36a-4b08-92b2-3e0f92e7b18a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:25.544655 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c844db0c-e36a-4b08-92b2-3e0f92e7b18a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:25.545390 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [req-07751eb3-13d2-4f41-80b7-614adf1849c7 req-2532b7e9-3aab-4618-bffc-0279aa5ed505 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079457 Aug 24 07:41:25.546328 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c844db0c-e36a-4b08-92b2-3e0f92e7b18a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:25.547075 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 82/153] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:41:25.547571 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c844db0c-e36a-4b08-92b2-3e0f92e7b18a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:25.560940 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-ca8f44e4-28bd-4cc7-832e-4e9efb2afba5 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:25.564581 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-ca8f44e4-28bd-4cc7-832e-4e9efb2afba5 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] [instance: 7a4bf12e-c36e-425e-bd1f-181bd4326de3] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:25.606225 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ca8f44e4-28bd-4cc7-832e-4e9efb2afba5 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:25.607083 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ca8f44e4-28bd-4cc7-832e-4e9efb2afba5 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:25.607739 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ca8f44e4-28bd-4cc7-832e-4e9efb2afba5 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:25.608668 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ca8f44e4-28bd-4cc7-832e-4e9efb2afba5 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:25.609670 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ca8f44e4-28bd-4cc7-832e-4e9efb2afba5 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:25.610673 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ca8f44e4-28bd-4cc7-832e-4e9efb2afba5 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:25.817630 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-ca8f44e4-28bd-4cc7-832e-4e9efb2afba5 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74594b3982264446b73d14bad3f46045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf922510f54d4d40ac00486394d67a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:25.830571 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-ca8f44e4-28bd-4cc7-832e-4e9efb2afba5 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] 10.222.0.42 "GET /compute/v2.1/servers/7a4bf12e-c36e-425e-bd1f-181bd4326de3" status: 200 len: 1319 microversion: 2.1 time: 0.280415 Aug 24 07:41:25.831506 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 83/154] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:25 2022] GET /compute/v2.1/servers/7a4bf12e-c36e-425e-bd1f-181bd4326de3 => generated 1319 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:25.952648 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-c844db0c-e36a-4b08-92b2-3e0f92e7b18a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:25.961590 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-c844db0c-e36a-4b08-92b2-3e0f92e7b18a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 200 len: 1522 microversion: 2.1 time: 0.450618 Aug 24 07:41:25.962786 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 72/155] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:25 2022] GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 1522 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:41:26.852313 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-c4d68f61-6a1c-47c8-84e6-d1d915186236 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:26.853495 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-c4d68f61-6a1c-47c8-84e6-d1d915186236 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] [instance: 7a4bf12e-c36e-425e-bd1f-181bd4326de3] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:26.870266 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c4d68f61-6a1c-47c8-84e6-d1d915186236 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:26.871497 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c4d68f61-6a1c-47c8-84e6-d1d915186236 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:26.872132 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c4d68f61-6a1c-47c8-84e6-d1d915186236 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:26.873240 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c4d68f61-6a1c-47c8-84e6-d1d915186236 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:26.873990 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c4d68f61-6a1c-47c8-84e6-d1d915186236 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:26.874967 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c4d68f61-6a1c-47c8-84e6-d1d915186236 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:26.983891 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-87cfbc45-55e4-49d0-b235-adba21712339 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:26.988416 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-87cfbc45-55e4-49d0-b235-adba21712339 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:26.996670 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-87cfbc45-55e4-49d0-b235-adba21712339 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:26.997559 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-87cfbc45-55e4-49d0-b235-adba21712339 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:26.998193 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-87cfbc45-55e4-49d0-b235-adba21712339 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:27.000490 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-87cfbc45-55e4-49d0-b235-adba21712339 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:27.001185 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-87cfbc45-55e4-49d0-b235-adba21712339 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:27.001802 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-87cfbc45-55e4-49d0-b235-adba21712339 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:27.043373 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell1:SELECT=100 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:41:27.112035 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-c4d68f61-6a1c-47c8-84e6-d1d915186236 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74594b3982264446b73d14bad3f46045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf922510f54d4d40ac00486394d67a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:27.136453 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-c4d68f61-6a1c-47c8-84e6-d1d915186236 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] 10.222.0.42 "GET /compute/v2.1/servers/7a4bf12e-c36e-425e-bd1f-181bd4326de3" status: 200 len: 1319 microversion: 2.1 time: 0.288461 Aug 24 07:41:27.137442 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 84/156] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:26 2022] GET /compute/v2.1/servers/7a4bf12e-c36e-425e-bd1f-181bd4326de3 => generated 1319 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:27.678570 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-87cfbc45-55e4-49d0-b235-adba21712339 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:27.689094 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-87cfbc45-55e4-49d0-b235-adba21712339 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 200 len: 1522 microversion: 2.1 time: 0.710369 Aug 24 07:41:27.689664 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 73/157] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:26 2022] GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 1522 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:41:28.160614 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-5f3d2cff-bbfd-4903-b6a7-eb717773da4c tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:28.164698 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-5f3d2cff-bbfd-4903-b6a7-eb717773da4c tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] [instance: 7a4bf12e-c36e-425e-bd1f-181bd4326de3] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:28.174978 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5f3d2cff-bbfd-4903-b6a7-eb717773da4c tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:28.175691 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5f3d2cff-bbfd-4903-b6a7-eb717773da4c tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:28.176222 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5f3d2cff-bbfd-4903-b6a7-eb717773da4c tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:28.177376 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5f3d2cff-bbfd-4903-b6a7-eb717773da4c tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:28.178054 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5f3d2cff-bbfd-4903-b6a7-eb717773da4c tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:28.179414 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5f3d2cff-bbfd-4903-b6a7-eb717773da4c tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:28.390877 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-5f3d2cff-bbfd-4903-b6a7-eb717773da4c tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74594b3982264446b73d14bad3f46045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf922510f54d4d40ac00486394d67a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:28.405828 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-5f3d2cff-bbfd-4903-b6a7-eb717773da4c tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] 10.222.0.42 "GET /compute/v2.1/servers/7a4bf12e-c36e-425e-bd1f-181bd4326de3" status: 200 len: 1319 microversion: 2.1 time: 0.251992 Aug 24 07:41:28.408292 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 85/158] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:28 2022] GET /compute/v2.1/servers/7a4bf12e-c36e-425e-bd1f-181bd4326de3 => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:28.711002 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-78b46eff-259c-49aa-a120-d9e9f02af78b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:28.712352 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-78b46eff-259c-49aa-a120-d9e9f02af78b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:28.724056 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-78b46eff-259c-49aa-a120-d9e9f02af78b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:28.724866 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-78b46eff-259c-49aa-a120-d9e9f02af78b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:28.725495 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-78b46eff-259c-49aa-a120-d9e9f02af78b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:28.726389 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-78b46eff-259c-49aa-a120-d9e9f02af78b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:28.727046 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-78b46eff-259c-49aa-a120-d9e9f02af78b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:28.727645 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-78b46eff-259c-49aa-a120-d9e9f02af78b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:28.942550 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-78b46eff-259c-49aa-a120-d9e9f02af78b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:28.954958 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-78b46eff-259c-49aa-a120-d9e9f02af78b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 200 len: 1522 microversion: 2.1 time: 0.248227 Aug 24 07:41:28.967600 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 74/159] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:28 2022] GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:29.144163 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-c0d0729d-233d-4267-8a57-c3e90a225954 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Action: 'create', calling method: .version_select at 0x7faf686e1a60>, body: {"keypair": {"name": "tempest-keypair-1548250468", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPl0N4k8OQAANpAby49aUy69GkODskNv7hi70B/mrijf4gS793zOuRRWv5gtCByIbnU1DMvsZcPUqMc/qHyZqUli5f1lRFcM7ZhWclT+r2UQPeXykfl6xxha5Emobp7JIQ=="}} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:41:29.201966 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.quota [None req-c0d0729d-233d-4267-8a57-c3e90a225954 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Getting quotas for project af5acb73124c485aa87e60b4e5d4f6d4. Resources: {'key_pairs'} {{(pid=127114) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:41:29.215499 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.quota [None req-c0d0729d-233d-4267-8a57-c3e90a225954 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Getting quotas for user f594c9344b2c472ba33ceef87ec88a0b and project af5acb73124c485aa87e60b4e5d4f6d4. Resources: {'key_pairs'} {{(pid=127114) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:41:29.339799 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-c0d0729d-233d-4267-8a57-c3e90a225954 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.443334 Aug 24 07:41:29.340636 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 86/160] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Aug 24 07:41:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:41:29.433271 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-d8a3af21-d690-41d6-9017-5a82fc128dcc tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:29.434450 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-d8a3af21-d690-41d6-9017-5a82fc128dcc tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] [instance: 7a4bf12e-c36e-425e-bd1f-181bd4326de3] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:29.453674 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d8a3af21-d690-41d6-9017-5a82fc128dcc tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:29.455286 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d8a3af21-d690-41d6-9017-5a82fc128dcc tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:29.456148 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d8a3af21-d690-41d6-9017-5a82fc128dcc tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:29.457060 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d8a3af21-d690-41d6-9017-5a82fc128dcc tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:29.460032 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d8a3af21-d690-41d6-9017-5a82fc128dcc tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:29.460726 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d8a3af21-d690-41d6-9017-5a82fc128dcc tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:29.767390 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-d8a3af21-d690-41d6-9017-5a82fc128dcc tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74594b3982264446b73d14bad3f46045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf922510f54d4d40ac00486394d67a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:29.779333 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-d8a3af21-d690-41d6-9017-5a82fc128dcc tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] 10.222.0.42 "GET /compute/v2.1/servers/7a4bf12e-c36e-425e-bd1f-181bd4326de3" status: 200 len: 1319 microversion: 2.1 time: 0.353135 Aug 24 07:41:29.833035 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 75/161] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:29 2022] GET /compute/v2.1/servers/7a4bf12e-c36e-425e-bd1f-181bd4326de3 => generated 1319 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:29.978827 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-e74de5e4-6bd3-49f1-bfa0-b6df17cec864 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:29.979676 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-e74de5e4-6bd3-49f1-bfa0-b6df17cec864 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:29.991948 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e74de5e4-6bd3-49f1-bfa0-b6df17cec864 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:29.992988 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e74de5e4-6bd3-49f1-bfa0-b6df17cec864 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:29.996355 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e74de5e4-6bd3-49f1-bfa0-b6df17cec864 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:29.998027 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e74de5e4-6bd3-49f1-bfa0-b6df17cec864 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:30.003725 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e74de5e4-6bd3-49f1-bfa0-b6df17cec864 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:30.004557 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e74de5e4-6bd3-49f1-bfa0-b6df17cec864 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:30.251454 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-e74de5e4-6bd3-49f1-bfa0-b6df17cec864 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:30.268797 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-e74de5e4-6bd3-49f1-bfa0-b6df17cec864 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 200 len: 1522 microversion: 2.1 time: 0.295237 Aug 24 07:41:30.269384 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 87/162] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:29 2022] GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:41:30.814292 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-b3b2ca4d-075a-43f6-8dd6-dd6e3bb3a986 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:30.815513 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-b3b2ca4d-075a-43f6-8dd6-dd6e3bb3a986 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] [instance: 7a4bf12e-c36e-425e-bd1f-181bd4326de3] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:30.819064 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell0:SELECT=2 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:41:30.834404 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell0:SELECT=8 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:41:30.846764 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b3b2ca4d-075a-43f6-8dd6-dd6e3bb3a986 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:30.847782 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b3b2ca4d-075a-43f6-8dd6-dd6e3bb3a986 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:30.849037 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b3b2ca4d-075a-43f6-8dd6-dd6e3bb3a986 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:30.854128 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b3b2ca4d-075a-43f6-8dd6-dd6e3bb3a986 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:30.855341 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b3b2ca4d-075a-43f6-8dd6-dd6e3bb3a986 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:30.861592 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b3b2ca4d-075a-43f6-8dd6-dd6e3bb3a986 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:31.279344 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-b3b2ca4d-075a-43f6-8dd6-dd6e3bb3a986 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74594b3982264446b73d14bad3f46045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf922510f54d4d40ac00486394d67a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:31.290417 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-98087dc2-a7c7-40e5-987c-17ba50665c27 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:31.291273 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-98087dc2-a7c7-40e5-987c-17ba50665c27 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:31.307064 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-b3b2ca4d-075a-43f6-8dd6-dd6e3bb3a986 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] 10.222.0.42 "GET /compute/v2.1/servers/7a4bf12e-c36e-425e-bd1f-181bd4326de3" status: 200 len: 1319 microversion: 2.1 time: 0.503867 Aug 24 07:41:31.333363 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 76/163] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:30 2022] GET /compute/v2.1/servers/7a4bf12e-c36e-425e-bd1f-181bd4326de3 => generated 1319 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:31.339051 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-98087dc2-a7c7-40e5-987c-17ba50665c27 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:31.340538 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-98087dc2-a7c7-40e5-987c-17ba50665c27 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:31.342478 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-98087dc2-a7c7-40e5-987c-17ba50665c27 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:31.345024 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-98087dc2-a7c7-40e5-987c-17ba50665c27 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:31.350849 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-98087dc2-a7c7-40e5-987c-17ba50665c27 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:31.351554 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-98087dc2-a7c7-40e5-987c-17ba50665c27 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:31.622524 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-98087dc2-a7c7-40e5-987c-17ba50665c27 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:31.632349 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-98087dc2-a7c7-40e5-987c-17ba50665c27 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 200 len: 1522 microversion: 2.1 time: 0.347200 Aug 24 07:41:31.632941 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 88/164] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:31 2022] GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 1522 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:32.340936 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-cca256dd-d6c3-42c2-a7ad-a2ec6b54d82b tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:32.341973 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-cca256dd-d6c3-42c2-a7ad-a2ec6b54d82b tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] [instance: 7a4bf12e-c36e-425e-bd1f-181bd4326de3] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:32.365434 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-cca256dd-d6c3-42c2-a7ad-a2ec6b54d82b tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:32.367827 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-cca256dd-d6c3-42c2-a7ad-a2ec6b54d82b tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:32.368526 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-cca256dd-d6c3-42c2-a7ad-a2ec6b54d82b tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:32.369453 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-cca256dd-d6c3-42c2-a7ad-a2ec6b54d82b tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:32.369865 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-cca256dd-d6c3-42c2-a7ad-a2ec6b54d82b tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:32.370281 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-cca256dd-d6c3-42c2-a7ad-a2ec6b54d82b tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:32.654346 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-1f11be46-476c-4ec2-a9f8-27b6ed1262f0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:32.655893 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-1f11be46-476c-4ec2-a9f8-27b6ed1262f0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:32.668996 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1f11be46-476c-4ec2-a9f8-27b6ed1262f0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:32.669987 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1f11be46-476c-4ec2-a9f8-27b6ed1262f0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:32.678723 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1f11be46-476c-4ec2-a9f8-27b6ed1262f0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:32.680603 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1f11be46-476c-4ec2-a9f8-27b6ed1262f0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:32.681492 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1f11be46-476c-4ec2-a9f8-27b6ed1262f0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:32.682172 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1f11be46-476c-4ec2-a9f8-27b6ed1262f0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:32.763201 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-cca256dd-d6c3-42c2-a7ad-a2ec6b54d82b tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74594b3982264446b73d14bad3f46045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf922510f54d4d40ac00486394d67a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:32.777744 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-cca256dd-d6c3-42c2-a7ad-a2ec6b54d82b tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] 10.222.0.42 "GET /compute/v2.1/servers/7a4bf12e-c36e-425e-bd1f-181bd4326de3" status: 200 len: 1319 microversion: 2.1 time: 0.443387 Aug 24 07:41:32.779720 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 77/165] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:32 2022] GET /compute/v2.1/servers/7a4bf12e-c36e-425e-bd1f-181bd4326de3 => generated 1319 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:32.995358 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-1f11be46-476c-4ec2-a9f8-27b6ed1262f0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:33.006040 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-1f11be46-476c-4ec2-a9f8-27b6ed1262f0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 200 len: 1522 microversion: 2.1 time: 0.356339 Aug 24 07:41:33.006997 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 89/166] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:32 2022] GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 1522 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:33.032770 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-06b407c5-cf2d-4186-ab6a-3bfe8c28d4ec tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-376827539", "imageRef": "4358f547-a499-43f3-9c84-925d78cd73db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "34afa070-0362-4f42-ac1a-67e0122ae46a"}], "security_groups": [{"name": "tempest-securitygroup--2086588035"}], "key_name": "tempest-keypair-1548250468", "user_data": "}} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:41:33.146978 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [req-bd7f9f01-029b-494c-9bc4-98156debe41e req-a336f2dd-8942-4cb5-b19a-5e45933bca91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a4bf12e-c36e-425e-bd1f-181bd4326de3", "name": "network-vif-plugged", "status": "completed", "tag": "51836419-0dfc-4a1a-b731-432c8a87e9fb"}]} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:41:33.164400 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-bd7f9f01-029b-494c-9bc4-98156debe41e req-a336f2dd-8942-4cb5-b19a-5e45933bca91 service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:33.166489 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-bd7f9f01-029b-494c-9bc4-98156debe41e req-a336f2dd-8942-4cb5-b19a-5e45933bca91 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:33.166958 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-bd7f9f01-029b-494c-9bc4-98156debe41e req-a336f2dd-8942-4cb5-b19a-5e45933bca91 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:33.224560 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.compute.server_external_events [req-bd7f9f01-029b-494c-9bc4-98156debe41e req-a336f2dd-8942-4cb5-b19a-5e45933bca91 service nova] Creating event network-vif-plugged:51836419-0dfc-4a1a-b731-432c8a87e9fb for instance 7a4bf12e-c36e-425e-bd1f-181bd4326de3 on hv-cinder-85427 Aug 24 07:41:33.252626 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [req-bd7f9f01-029b-494c-9bc4-98156debe41e req-a336f2dd-8942-4cb5-b19a-5e45933bca91 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113513 Aug 24 07:41:33.253272 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 90/167] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:41:33.265064 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.network.neutron [None req-06b407c5-cf2d-4186-ab6a-3bfe8c28d4ec tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] validate_networks() for [('34afa070-0362-4f42-ac1a-67e0122ae46a', None, None, None, None, None)] {{(pid=127113) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 07:41:33.804663 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-de7c300f-2983-4e25-8101-8863e01dc67c tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:33.805353 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-de7c300f-2983-4e25-8101-8863e01dc67c tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] [instance: 7a4bf12e-c36e-425e-bd1f-181bd4326de3] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:33.817473 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-de7c300f-2983-4e25-8101-8863e01dc67c tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:33.826439 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-de7c300f-2983-4e25-8101-8863e01dc67c tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:33.827423 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-de7c300f-2983-4e25-8101-8863e01dc67c tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:33.828366 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-de7c300f-2983-4e25-8101-8863e01dc67c tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:33.831688 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-de7c300f-2983-4e25-8101-8863e01dc67c tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:33.832305 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-de7c300f-2983-4e25-8101-8863e01dc67c tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:34.147766 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.virt.hardware [None req-06b407c5-cf2d-4186-ab6a-3bfe8c28d4ec tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Flavor limits 0:0:0 {{(pid=127113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 07:41:34.148265 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.virt.hardware [None req-06b407c5-cf2d-4186-ab6a-3bfe8c28d4ec tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Image limits 0:0:0 {{(pid=127113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 07:41:34.148777 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.virt.hardware [None req-06b407c5-cf2d-4186-ab6a-3bfe8c28d4ec tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Flavor pref 0:0:0 {{(pid=127113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 07:41:34.149191 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.virt.hardware [None req-06b407c5-cf2d-4186-ab6a-3bfe8c28d4ec tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Image pref 0:0:0 {{(pid=127113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 07:41:34.149592 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.virt.hardware [None req-06b407c5-cf2d-4186-ab6a-3bfe8c28d4ec tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 07:41:34.155051 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:41:34.161011 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-de7c300f-2983-4e25-8101-8863e01dc67c tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74594b3982264446b73d14bad3f46045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf922510f54d4d40ac00486394d67a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:34.164806 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-06b407c5-cf2d-4186-ab6a-3bfe8c28d4ec tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:34.165363 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-06b407c5-cf2d-4186-ab6a-3bfe8c28d4ec tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:34.165989 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-06b407c5-cf2d-4186-ab6a-3bfe8c28d4ec tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:34.167302 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-06b407c5-cf2d-4186-ab6a-3bfe8c28d4ec tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:34.167861 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-06b407c5-cf2d-4186-ab6a-3bfe8c28d4ec tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:34.168379 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-06b407c5-cf2d-4186-ab6a-3bfe8c28d4ec tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:34.179926 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-de7c300f-2983-4e25-8101-8863e01dc67c tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] 10.222.0.42 "GET /compute/v2.1/servers/7a4bf12e-c36e-425e-bd1f-181bd4326de3" status: 200 len: 1319 microversion: 2.1 time: 0.380260 Aug 24 07:41:34.180719 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 91/168] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:33 2022] GET /compute/v2.1/servers/7a4bf12e-c36e-425e-bd1f-181bd4326de3 => generated 1319 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:41:34.192401 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.quota [None req-06b407c5-cf2d-4186-ab6a-3bfe8c28d4ec tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Getting quotas for project af5acb73124c485aa87e60b4e5d4f6d4. Resources: {'cores', 'ram', 'instances'} {{(pid=127113) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:41:34.196756 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.quota [None req-06b407c5-cf2d-4186-ab6a-3bfe8c28d4ec tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Getting quotas for user f594c9344b2c472ba33ceef87ec88a0b and project af5acb73124c485aa87e60b4e5d4f6d4. Resources: {'cores', 'ram', 'instances'} {{(pid=127113) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:41:34.209363 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-06b407c5-cf2d-4186-ab6a-3bfe8c28d4ec tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Going to run 1 instances... {{(pid=127113) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 07:41:34.217139 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-c77d7769-2b4e-4b0a-8f65-87ce10fbb26e tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:34.217425 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-06b407c5-cf2d-4186-ab6a-3bfe8c28d4ec tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: d596e142-eb18-49d4-8eb8-bec422282059] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4358f547-a499-43f3-9c84-925d78cd73db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127113) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 07:41:34.221141 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-c77d7769-2b4e-4b0a-8f65-87ce10fbb26e tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:34.231512 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c77d7769-2b4e-4b0a-8f65-87ce10fbb26e tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:34.232000 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c77d7769-2b4e-4b0a-8f65-87ce10fbb26e tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:34.233198 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c77d7769-2b4e-4b0a-8f65-87ce10fbb26e tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:34.234105 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c77d7769-2b4e-4b0a-8f65-87ce10fbb26e tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:34.235487 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c77d7769-2b4e-4b0a-8f65-87ce10fbb26e tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:34.236092 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c77d7769-2b4e-4b0a-8f65-87ce10fbb26e tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:34.281583 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-06b407c5-cf2d-4186-ab6a-3bfe8c28d4ec tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.254628 Aug 24 07:41:34.286855 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 78/169] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 24 07:41:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 1261 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 07:41:34.297893 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-df24601c-aeb2-4c25-935a-fea231aba355 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:34.301028 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-df24601c-aeb2-4c25-935a-fea231aba355 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: d596e142-eb18-49d4-8eb8-bec422282059] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:34.395855 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-df24601c-aeb2-4c25-935a-fea231aba355 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:34.399670 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-c77d7769-2b4e-4b0a-8f65-87ce10fbb26e tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:34.411553 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-df24601c-aeb2-4c25-935a-fea231aba355 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/d596e142-eb18-49d4-8eb8-bec422282059" status: 200 len: 1241 microversion: 2.1 time: 0.115942 Aug 24 07:41:34.413821 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 79/170] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:34 2022] GET /compute/v2.1/servers/d596e142-eb18-49d4-8eb8-bec422282059 => generated 1241 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:34.415970 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-c77d7769-2b4e-4b0a-8f65-87ce10fbb26e tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 200 len: 1502 microversion: 2.1 time: 0.233099 Aug 24 07:41:34.416648 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 92/171] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:34 2022] GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 1502 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:34.437743 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-01a366c2-ed65-46a9-9071-d855f2f2ba3e tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:34.439628 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-01a366c2-ed65-46a9-9071-d855f2f2ba3e tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:34.446366 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-01a366c2-ed65-46a9-9071-d855f2f2ba3e tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:34.447168 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-01a366c2-ed65-46a9-9071-d855f2f2ba3e tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:34.447671 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-01a366c2-ed65-46a9-9071-d855f2f2ba3e tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:34.448461 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-01a366c2-ed65-46a9-9071-d855f2f2ba3e tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:34.448964 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-01a366c2-ed65-46a9-9071-d855f2f2ba3e tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:34.449458 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-01a366c2-ed65-46a9-9071-d855f2f2ba3e tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:34.905888 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-01a366c2-ed65-46a9-9071-d855f2f2ba3e tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:34.928481 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-01a366c2-ed65-46a9-9071-d855f2f2ba3e tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1516 microversion: 2.1 time: 0.494897 Aug 24 07:41:34.947845 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 80/172] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:34 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1516 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:35.203656 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-0e827699-8ee9-4922-bdc7-6d2f920ba37d tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:35.205902 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-0e827699-8ee9-4922-bdc7-6d2f920ba37d tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] [instance: 7a4bf12e-c36e-425e-bd1f-181bd4326de3] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:35.216694 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0e827699-8ee9-4922-bdc7-6d2f920ba37d tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:35.218232 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0e827699-8ee9-4922-bdc7-6d2f920ba37d tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:35.219286 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0e827699-8ee9-4922-bdc7-6d2f920ba37d tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:35.220253 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0e827699-8ee9-4922-bdc7-6d2f920ba37d tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:35.220749 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0e827699-8ee9-4922-bdc7-6d2f920ba37d tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:35.221249 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0e827699-8ee9-4922-bdc7-6d2f920ba37d tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:35.432202 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-0e827699-8ee9-4922-bdc7-6d2f920ba37d tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74594b3982264446b73d14bad3f46045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf922510f54d4d40ac00486394d67a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:35.447184 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-6b7efb5c-09c9-42ba-96da-8d0824b8bece tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:35.447184 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-6b7efb5c-09c9-42ba-96da-8d0824b8bece tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: d596e142-eb18-49d4-8eb8-bec422282059] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:35.447815 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-0e827699-8ee9-4922-bdc7-6d2f920ba37d tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] 10.222.0.42 "GET /compute/v2.1/servers/7a4bf12e-c36e-425e-bd1f-181bd4326de3" status: 200 len: 1319 microversion: 2.1 time: 0.244989 Aug 24 07:41:35.447815 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 93/173] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:35 2022] GET /compute/v2.1/servers/7a4bf12e-c36e-425e-bd1f-181bd4326de3 => generated 1319 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:35.457583 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6b7efb5c-09c9-42ba-96da-8d0824b8bece tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:35.459403 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6b7efb5c-09c9-42ba-96da-8d0824b8bece tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:35.467134 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6b7efb5c-09c9-42ba-96da-8d0824b8bece tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:35.468010 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6b7efb5c-09c9-42ba-96da-8d0824b8bece tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:35.470361 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6b7efb5c-09c9-42ba-96da-8d0824b8bece tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:35.471945 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6b7efb5c-09c9-42ba-96da-8d0824b8bece tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:35.568208 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-9b244410-01ef-4ce2-be90-983cfb7c8f3f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-977547576", "imageRef": "4358f547-a499-43f3-9c84-925d78cd73db", "flavorRef": "452", "networks": [{"uuid": "34f9c04a-0edf-4f6a-9a75-8ec574dd0214"}]}} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:41:35.584721 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-6b7efb5c-09c9-42ba-96da-8d0824b8bece tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:35.596391 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-6b7efb5c-09c9-42ba-96da-8d0824b8bece tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/d596e142-eb18-49d4-8eb8-bec422282059" status: 200 len: 1293 microversion: 2.1 time: 0.165217 Aug 24 07:41:35.596974 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 81/174] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:35 2022] GET /compute/v2.1/servers/d596e142-eb18-49d4-8eb8-bec422282059 => generated 1293 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:41:35.658443 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.network.neutron [None req-9b244410-01ef-4ce2-be90-983cfb7c8f3f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] validate_networks() for [('34f9c04a-0edf-4f6a-9a75-8ec574dd0214', None, None, None, None, None)] {{(pid=127114) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 07:41:36.103372 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-9b244410-01ef-4ce2-be90-983cfb7c8f3f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Flavor limits 0:0:0 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 07:41:36.104114 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-9b244410-01ef-4ce2-be90-983cfb7c8f3f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Image limits 0:0:0 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 07:41:36.104959 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-9b244410-01ef-4ce2-be90-983cfb7c8f3f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Flavor pref 0:0:0 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 07:41:36.105549 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-9b244410-01ef-4ce2-be90-983cfb7c8f3f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Image pref 0:0:0 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 07:41:36.106211 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-9b244410-01ef-4ce2-be90-983cfb7c8f3f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 07:41:36.116677 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9b244410-01ef-4ce2-be90-983cfb7c8f3f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:36.117295 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9b244410-01ef-4ce2-be90-983cfb7c8f3f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:36.117732 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9b244410-01ef-4ce2-be90-983cfb7c8f3f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:36.118513 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9b244410-01ef-4ce2-be90-983cfb7c8f3f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:36.119012 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9b244410-01ef-4ce2-be90-983cfb7c8f3f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:36.119420 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9b244410-01ef-4ce2-be90-983cfb7c8f3f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:36.150931 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.quota [None req-9b244410-01ef-4ce2-be90-983cfb7c8f3f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Getting quotas for project 71f10902cae64a09b587e9a481ce9e41. Resources: {'cores', 'ram', 'instances'} {{(pid=127114) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:41:36.158090 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.quota [None req-9b244410-01ef-4ce2-be90-983cfb7c8f3f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Getting quotas for user c7f3a776c48e4cebb7624d215f93cd1a and project 71f10902cae64a09b587e9a481ce9e41. Resources: {'cores', 'ram', 'instances'} {{(pid=127114) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:41:36.176738 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-9b244410-01ef-4ce2-be90-983cfb7c8f3f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Going to run 1 instances... {{(pid=127114) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 07:41:36.179595 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-9b244410-01ef-4ce2-be90-983cfb7c8f3f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 595e5cfe-e53e-40d4-8841-cbc65440f5f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4358f547-a499-43f3-9c84-925d78cd73db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127114) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 07:41:36.231298 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-9b244410-01ef-4ce2-be90-983cfb7c8f3f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.667015 Aug 24 07:41:36.231936 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 94/175] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 24 07:41:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 07:41:36.243548 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-83f6b7a1-5ab2-44fc-be8f-bc40cbd24fb7 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:36.244467 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-83f6b7a1-5ab2-44fc-be8f-bc40cbd24fb7 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 595e5cfe-e53e-40d4-8841-cbc65440f5f1] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:36.376921 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-83f6b7a1-5ab2-44fc-be8f-bc40cbd24fb7 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:36.395245 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-83f6b7a1-5ab2-44fc-be8f-bc40cbd24fb7 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1" status: 200 len: 1213 microversion: 2.1 time: 0.150979 Aug 24 07:41:36.422639 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 82/176] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:36 2022] GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1 => generated 1213 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:36.474433 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-c5d0f822-e493-466f-a700-7b43927ac345 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:36.475228 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-c5d0f822-e493-466f-a700-7b43927ac345 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] [instance: 7a4bf12e-c36e-425e-bd1f-181bd4326de3] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:36.483419 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c5d0f822-e493-466f-a700-7b43927ac345 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:36.483969 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c5d0f822-e493-466f-a700-7b43927ac345 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:36.484463 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c5d0f822-e493-466f-a700-7b43927ac345 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:36.485380 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c5d0f822-e493-466f-a700-7b43927ac345 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:36.485895 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c5d0f822-e493-466f-a700-7b43927ac345 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:36.486461 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c5d0f822-e493-466f-a700-7b43927ac345 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:36.536197 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-1be380ab-69b9-4578-825c-fc575e2de786 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:41:36.539498 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-1be380ab-69b9-4578-825c-fc575e2de786 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:36.549235 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1be380ab-69b9-4578-825c-fc575e2de786 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:36.550018 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1be380ab-69b9-4578-825c-fc575e2de786 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:36.550468 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1be380ab-69b9-4578-825c-fc575e2de786 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:36.551302 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1be380ab-69b9-4578-825c-fc575e2de786 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:36.551780 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1be380ab-69b9-4578-825c-fc575e2de786 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:36.552313 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1be380ab-69b9-4578-825c-fc575e2de786 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:36.612929 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.objects.instance [None req-1be380ab-69b9-4578-825c-fc575e2de786 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lazy-loading 'flavor' on Instance uuid 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 {{(pid=127113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:41:36.669223 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-c5d0f822-e493-466f-a700-7b43927ac345 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74594b3982264446b73d14bad3f46045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf922510f54d4d40ac00486394d67a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:36.691987 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-c5d0f822-e493-466f-a700-7b43927ac345 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] 10.222.0.42 "GET /compute/v2.1/servers/7a4bf12e-c36e-425e-bd1f-181bd4326de3" status: 200 len: 1508 microversion: 2.1 time: 0.223255 Aug 24 07:41:36.694653 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 95/177] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:36 2022] GET /compute/v2.1/servers/7a4bf12e-c36e-425e-bd1f-181bd4326de3 => generated 1508 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:36.706601 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-fb2233fb-3af7-407d-8ff6-3676b4855838 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:36.707583 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-fb2233fb-3af7-407d-8ff6-3676b4855838 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: d596e142-eb18-49d4-8eb8-bec422282059] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:36.715223 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fb2233fb-3af7-407d-8ff6-3676b4855838 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:36.715768 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fb2233fb-3af7-407d-8ff6-3676b4855838 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:36.716209 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fb2233fb-3af7-407d-8ff6-3676b4855838 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:36.738848 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fb2233fb-3af7-407d-8ff6-3676b4855838 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:36.740153 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fb2233fb-3af7-407d-8ff6-3676b4855838 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:36.740823 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fb2233fb-3af7-407d-8ff6-3676b4855838 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:36.758402 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-1be380ab-69b9-4578-825c-fc575e2de786 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "POST /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33/action" status: 200 len: 32 microversion: 2.1 time: 0.225163 Aug 24 07:41:36.759840 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 83/178] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 24 07:41:36 2022] POST /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33/action => generated 32 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 07:41:36.785424 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-b3bf8ffc-a3fd-4d63-aee9-ccfb3b8b240a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:36.787980 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-b3bf8ffc-a3fd-4d63-aee9-ccfb3b8b240a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:36.802246 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b3bf8ffc-a3fd-4d63-aee9-ccfb3b8b240a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:36.804366 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b3bf8ffc-a3fd-4d63-aee9-ccfb3b8b240a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:36.805243 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b3bf8ffc-a3fd-4d63-aee9-ccfb3b8b240a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:36.808150 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b3bf8ffc-a3fd-4d63-aee9-ccfb3b8b240a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:36.809028 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b3bf8ffc-a3fd-4d63-aee9-ccfb3b8b240a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:36.810386 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b3bf8ffc-a3fd-4d63-aee9-ccfb3b8b240a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:36.865942 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-fb2233fb-3af7-407d-8ff6-3676b4855838 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:36.878908 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-fb2233fb-3af7-407d-8ff6-3676b4855838 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/d596e142-eb18-49d4-8eb8-bec422282059" status: 200 len: 1299 microversion: 2.1 time: 0.183107 Aug 24 07:41:36.880220 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 96/179] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:36 2022] GET /compute/v2.1/servers/d596e142-eb18-49d4-8eb8-bec422282059 => generated 1299 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:37.217750 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-b3bf8ffc-a3fd-4d63-aee9-ccfb3b8b240a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:37.247773 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-b3bf8ffc-a3fd-4d63-aee9-ccfb3b8b240a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1522 microversion: 2.1 time: 0.475362 Aug 24 07:41:37.249920 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 84/180] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:36 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1522 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:37.431286 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-4fc51ed5-e885-4ba2-adc9-c0def2a7eee4 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:37.431865 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-4fc51ed5-e885-4ba2-adc9-c0def2a7eee4 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 595e5cfe-e53e-40d4-8841-cbc65440f5f1] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:37.440073 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4fc51ed5-e885-4ba2-adc9-c0def2a7eee4 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:37.440622 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4fc51ed5-e885-4ba2-adc9-c0def2a7eee4 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:37.441146 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4fc51ed5-e885-4ba2-adc9-c0def2a7eee4 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:37.441855 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4fc51ed5-e885-4ba2-adc9-c0def2a7eee4 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:37.442374 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4fc51ed5-e885-4ba2-adc9-c0def2a7eee4 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:37.442824 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4fc51ed5-e885-4ba2-adc9-c0def2a7eee4 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:37.518422 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-4fc51ed5-e885-4ba2-adc9-c0def2a7eee4 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:37.528276 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-4fc51ed5-e885-4ba2-adc9-c0def2a7eee4 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1" status: 200 len: 1265 microversion: 2.1 time: 0.101607 Aug 24 07:41:37.540846 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 97/181] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:37 2022] GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1 => generated 1265 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:37.904462 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-660c5093-c274-4f73-ba60-19185d6c089a tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:37.911307 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-660c5093-c274-4f73-ba60-19185d6c089a tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: d596e142-eb18-49d4-8eb8-bec422282059] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:37.922217 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-660c5093-c274-4f73-ba60-19185d6c089a tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:37.924968 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-660c5093-c274-4f73-ba60-19185d6c089a tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:37.925433 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-660c5093-c274-4f73-ba60-19185d6c089a tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:37.926162 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-660c5093-c274-4f73-ba60-19185d6c089a tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:37.926620 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-660c5093-c274-4f73-ba60-19185d6c089a tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:37.929541 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-660c5093-c274-4f73-ba60-19185d6c089a tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:38.271822 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-25272779-b62f-4d37-b4c3-0bb9b7b96c4b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:38.272436 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-25272779-b62f-4d37-b4c3-0bb9b7b96c4b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:38.279289 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-25272779-b62f-4d37-b4c3-0bb9b7b96c4b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:38.280306 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-25272779-b62f-4d37-b4c3-0bb9b7b96c4b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:38.280938 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-25272779-b62f-4d37-b4c3-0bb9b7b96c4b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:38.285483 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-660c5093-c274-4f73-ba60-19185d6c089a tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:38.291019 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-25272779-b62f-4d37-b4c3-0bb9b7b96c4b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:38.291801 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-25272779-b62f-4d37-b4c3-0bb9b7b96c4b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:38.292448 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-25272779-b62f-4d37-b4c3-0bb9b7b96c4b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:38.299115 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-660c5093-c274-4f73-ba60-19185d6c089a tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/d596e142-eb18-49d4-8eb8-bec422282059" status: 200 len: 1367 microversion: 2.1 time: 0.399551 Aug 24 07:41:38.299739 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 85/182] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:37 2022] GET /compute/v2.1/servers/d596e142-eb18-49d4-8eb8-bec422282059 => generated 1367 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:38.349776 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell1:SELECT=100 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:41:38.545916 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-25272779-b62f-4d37-b4c3-0bb9b7b96c4b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:38.556265 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-a7419d21-0cb1-4c88-af0e-ed336cbd82fd tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:38.557452 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-a7419d21-0cb1-4c88-af0e-ed336cbd82fd tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 595e5cfe-e53e-40d4-8841-cbc65440f5f1] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:38.560979 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-25272779-b62f-4d37-b4c3-0bb9b7b96c4b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1522 microversion: 2.1 time: 0.294454 Aug 24 07:41:38.561451 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 98/183] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:38 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:38.565838 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a7419d21-0cb1-4c88-af0e-ed336cbd82fd tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:38.566641 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a7419d21-0cb1-4c88-af0e-ed336cbd82fd tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:38.567318 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a7419d21-0cb1-4c88-af0e-ed336cbd82fd tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:38.568448 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a7419d21-0cb1-4c88-af0e-ed336cbd82fd tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:38.569107 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a7419d21-0cb1-4c88-af0e-ed336cbd82fd tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:38.569789 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a7419d21-0cb1-4c88-af0e-ed336cbd82fd tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:38.666414 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-a7419d21-0cb1-4c88-af0e-ed336cbd82fd tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:38.685604 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-a7419d21-0cb1-4c88-af0e-ed336cbd82fd tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1" status: 200 len: 1271 microversion: 2.1 time: 0.134298 Aug 24 07:41:38.687818 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 86/184] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:38 2022] GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1 => generated 1271 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:39.036828 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [req-7e5edada-e809-4d7d-b943-c532168eba73 req-1555ee6e-687d-40d2-a8e3-c80d9f7f1bb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d596e142-eb18-49d4-8eb8-bec422282059", "tag": "8feec3b6-e865-473e-bce9-488008443570"}]} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:41:39.083233 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-7e5edada-e809-4d7d-b943-c532168eba73 req-1555ee6e-687d-40d2-a8e3-c80d9f7f1bb0 service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:39.099996 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-7e5edada-e809-4d7d-b943-c532168eba73 req-1555ee6e-687d-40d2-a8e3-c80d9f7f1bb0 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:39.103929 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-7e5edada-e809-4d7d-b943-c532168eba73 req-1555ee6e-687d-40d2-a8e3-c80d9f7f1bb0 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:39.154546 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.compute.server_external_events [req-7e5edada-e809-4d7d-b943-c532168eba73 req-1555ee6e-687d-40d2-a8e3-c80d9f7f1bb0 service nova] Creating event network-changed:8feec3b6-e865-473e-bce9-488008443570 for instance d596e142-eb18-49d4-8eb8-bec422282059 on hv-cinder-85427 Aug 24 07:41:39.165536 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [req-7e5edada-e809-4d7d-b943-c532168eba73 req-1555ee6e-687d-40d2-a8e3-c80d9f7f1bb0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128987 Aug 24 07:41:39.165536 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 99/185] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:41:39.320578 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-b04e220d-7dd5-4889-8386-7761a1530f4c tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:39.321273 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-b04e220d-7dd5-4889-8386-7761a1530f4c tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: d596e142-eb18-49d4-8eb8-bec422282059] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:39.330433 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b04e220d-7dd5-4889-8386-7761a1530f4c tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:39.330900 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b04e220d-7dd5-4889-8386-7761a1530f4c tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:39.331331 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b04e220d-7dd5-4889-8386-7761a1530f4c tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:39.335246 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b04e220d-7dd5-4889-8386-7761a1530f4c tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:39.336266 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b04e220d-7dd5-4889-8386-7761a1530f4c tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:39.337043 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b04e220d-7dd5-4889-8386-7761a1530f4c tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:39.585188 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-bd9b5c74-2295-4337-ba4f-60b6e402b878 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:39.586832 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-bd9b5c74-2295-4337-ba4f-60b6e402b878 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:39.594249 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-b04e220d-7dd5-4889-8386-7761a1530f4c tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:39.598890 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-bd9b5c74-2295-4337-ba4f-60b6e402b878 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:39.600293 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-bd9b5c74-2295-4337-ba4f-60b6e402b878 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:39.600752 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-bd9b5c74-2295-4337-ba4f-60b6e402b878 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:39.601463 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-bd9b5c74-2295-4337-ba4f-60b6e402b878 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:39.602073 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-bd9b5c74-2295-4337-ba4f-60b6e402b878 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:39.604721 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-bd9b5c74-2295-4337-ba4f-60b6e402b878 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:39.605539 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-b04e220d-7dd5-4889-8386-7761a1530f4c tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/d596e142-eb18-49d4-8eb8-bec422282059" status: 200 len: 1367 microversion: 2.1 time: 0.288727 Aug 24 07:41:39.606218 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 87/186] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:39 2022] GET /compute/v2.1/servers/d596e142-eb18-49d4-8eb8-bec422282059 => generated 1367 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:39.659672 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [req-b096babe-61f5-4a6d-8973-34d379dbe90b req-12958927-43a0-4399-8c4e-ea2bdd702421 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "595e5cfe-e53e-40d4-8841-cbc65440f5f1", "tag": "96c9a585-ee04-446f-8199-ee2f9ea2848e"}]} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:41:39.681895 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-b096babe-61f5-4a6d-8973-34d379dbe90b req-12958927-43a0-4399-8c4e-ea2bdd702421 service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:39.689797 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-b096babe-61f5-4a6d-8973-34d379dbe90b req-12958927-43a0-4399-8c4e-ea2bdd702421 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:39.690436 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-b096babe-61f5-4a6d-8973-34d379dbe90b req-12958927-43a0-4399-8c4e-ea2bdd702421 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:39.717047 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.compute.server_external_events [req-b096babe-61f5-4a6d-8973-34d379dbe90b req-12958927-43a0-4399-8c4e-ea2bdd702421 service nova] Creating event network-changed:96c9a585-ee04-446f-8199-ee2f9ea2848e for instance 595e5cfe-e53e-40d4-8841-cbc65440f5f1 on hv-cinder-85427 Aug 24 07:41:39.725802 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [req-b096babe-61f5-4a6d-8973-34d379dbe90b req-12958927-43a0-4399-8c4e-ea2bdd702421 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070568 Aug 24 07:41:39.730113 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 88/187] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:41:39.737865 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-7865ebd4-537d-4db7-8d88-ab1dc096fa3a tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:39.738915 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-7865ebd4-537d-4db7-8d88-ab1dc096fa3a tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 595e5cfe-e53e-40d4-8841-cbc65440f5f1] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:39.746608 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7865ebd4-537d-4db7-8d88-ab1dc096fa3a tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:39.747334 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7865ebd4-537d-4db7-8d88-ab1dc096fa3a tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:39.747747 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7865ebd4-537d-4db7-8d88-ab1dc096fa3a tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:39.748814 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7865ebd4-537d-4db7-8d88-ab1dc096fa3a tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:39.749563 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7865ebd4-537d-4db7-8d88-ab1dc096fa3a tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:39.750201 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7865ebd4-537d-4db7-8d88-ab1dc096fa3a tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:39.891096 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-bd9b5c74-2295-4337-ba4f-60b6e402b878 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:39.897866 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-7865ebd4-537d-4db7-8d88-ab1dc096fa3a tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:39.899308 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-bd9b5c74-2295-4337-ba4f-60b6e402b878 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1522 microversion: 2.1 time: 0.320983 Aug 24 07:41:39.899897 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 100/188] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:39 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1522 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:41:39.905756 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-7865ebd4-537d-4db7-8d88-ab1dc096fa3a tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1" status: 200 len: 1313 microversion: 2.1 time: 0.174013 Aug 24 07:41:39.906429 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 89/189] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:39 2022] GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1 => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:40.569810 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-d3bf6129-cf73-48d0-a2ae-09dae6c5a8f4 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:40.570329 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-d3bf6129-cf73-48d0-a2ae-09dae6c5a8f4 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:40.577001 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d3bf6129-cf73-48d0-a2ae-09dae6c5a8f4 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:40.583612 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d3bf6129-cf73-48d0-a2ae-09dae6c5a8f4 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:40.585600 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d3bf6129-cf73-48d0-a2ae-09dae6c5a8f4 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:40.586451 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d3bf6129-cf73-48d0-a2ae-09dae6c5a8f4 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:40.586965 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d3bf6129-cf73-48d0-a2ae-09dae6c5a8f4 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:40.588132 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d3bf6129-cf73-48d0-a2ae-09dae6c5a8f4 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:40.619155 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-d3bf6129-cf73-48d0-a2ae-09dae6c5a8f4 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c/ips" status: 200 len: 145 microversion: 2.1 time: 0.051670 Aug 24 07:41:40.619155 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 101/190] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Aug 24 07:41:40 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c/ips => generated 145 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:41:40.629453 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-2c6584bc-eea0-4cad-8cce-9666990af2de tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:40.630611 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-2c6584bc-eea0-4cad-8cce-9666990af2de tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: d596e142-eb18-49d4-8eb8-bec422282059] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:40.638271 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2c6584bc-eea0-4cad-8cce-9666990af2de tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:40.639170 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2c6584bc-eea0-4cad-8cce-9666990af2de tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:40.639700 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2c6584bc-eea0-4cad-8cce-9666990af2de tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:40.640521 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2c6584bc-eea0-4cad-8cce-9666990af2de tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:40.641150 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2c6584bc-eea0-4cad-8cce-9666990af2de tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:40.642157 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2c6584bc-eea0-4cad-8cce-9666990af2de tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:40.836810 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-2c6584bc-eea0-4cad-8cce-9666990af2de tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:40.845005 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-2c6584bc-eea0-4cad-8cce-9666990af2de tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/d596e142-eb18-49d4-8eb8-bec422282059" status: 200 len: 1367 microversion: 2.1 time: 0.221877 Aug 24 07:41:40.845580 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 90/191] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:40 2022] GET /compute/v2.1/servers/d596e142-eb18-49d4-8eb8-bec422282059 => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:40.931869 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-6ec7247f-098d-47c0-94f5-0b92c3236ad9 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:40.932267 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-104740bb-06db-4c1b-a61b-2939d7fe681f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:40.933023 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-104740bb-06db-4c1b-a61b-2939d7fe681f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:40.933509 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-6ec7247f-098d-47c0-94f5-0b92c3236ad9 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 595e5cfe-e53e-40d4-8841-cbc65440f5f1] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:40.942762 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-104740bb-06db-4c1b-a61b-2939d7fe681f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:40.943112 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6ec7247f-098d-47c0-94f5-0b92c3236ad9 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:40.943790 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-104740bb-06db-4c1b-a61b-2939d7fe681f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:40.944073 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6ec7247f-098d-47c0-94f5-0b92c3236ad9 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:40.944514 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6ec7247f-098d-47c0-94f5-0b92c3236ad9 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:40.944648 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-104740bb-06db-4c1b-a61b-2939d7fe681f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:40.945579 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-104740bb-06db-4c1b-a61b-2939d7fe681f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:40.946181 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6ec7247f-098d-47c0-94f5-0b92c3236ad9 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:40.946475 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-104740bb-06db-4c1b-a61b-2939d7fe681f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:40.947000 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6ec7247f-098d-47c0-94f5-0b92c3236ad9 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:40.947621 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6ec7247f-098d-47c0-94f5-0b92c3236ad9 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:40.948048 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-104740bb-06db-4c1b-a61b-2939d7fe681f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:40.980094 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:41:41.188817 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-6ec7247f-098d-47c0-94f5-0b92c3236ad9 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:41.197097 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-6ec7247f-098d-47c0-94f5-0b92c3236ad9 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1" status: 200 len: 1313 microversion: 2.1 time: 0.274130 Aug 24 07:41:41.197605 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 91/192] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:40 2022] GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1 => generated 1313 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:41.373620 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-104740bb-06db-4c1b-a61b-2939d7fe681f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:41.381907 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-104740bb-06db-4c1b-a61b-2939d7fe681f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1522 microversion: 2.1 time: 0.464511 Aug 24 07:41:41.399257 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 102/193] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:40 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1522 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:41:41.868604 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-53a359fc-cd9f-4343-9589-f99a7849cbc1 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:41.869706 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-53a359fc-cd9f-4343-9589-f99a7849cbc1 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: d596e142-eb18-49d4-8eb8-bec422282059] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:41.888015 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-53a359fc-cd9f-4343-9589-f99a7849cbc1 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:41.888015 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-53a359fc-cd9f-4343-9589-f99a7849cbc1 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:41.888015 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-53a359fc-cd9f-4343-9589-f99a7849cbc1 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:41.888015 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-53a359fc-cd9f-4343-9589-f99a7849cbc1 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:41.888348 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-53a359fc-cd9f-4343-9589-f99a7849cbc1 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:41.888348 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-53a359fc-cd9f-4343-9589-f99a7849cbc1 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:42.069144 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-53a359fc-cd9f-4343-9589-f99a7849cbc1 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:42.077127 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-53a359fc-cd9f-4343-9589-f99a7849cbc1 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/d596e142-eb18-49d4-8eb8-bec422282059" status: 200 len: 1367 microversion: 2.1 time: 0.213589 Aug 24 07:41:42.077689 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 92/194] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:41 2022] GET /compute/v2.1/servers/d596e142-eb18-49d4-8eb8-bec422282059 => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:42.217340 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-21cee052-9794-44eb-a6be-466c6dd676a7 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:42.218262 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-21cee052-9794-44eb-a6be-466c6dd676a7 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 595e5cfe-e53e-40d4-8841-cbc65440f5f1] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:42.225056 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-21cee052-9794-44eb-a6be-466c6dd676a7 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:42.225610 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-21cee052-9794-44eb-a6be-466c6dd676a7 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:42.226104 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-21cee052-9794-44eb-a6be-466c6dd676a7 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:42.226915 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-21cee052-9794-44eb-a6be-466c6dd676a7 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:42.227432 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-21cee052-9794-44eb-a6be-466c6dd676a7 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:42.227935 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-21cee052-9794-44eb-a6be-466c6dd676a7 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:42.368357 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-21cee052-9794-44eb-a6be-466c6dd676a7 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:42.377112 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-21cee052-9794-44eb-a6be-466c6dd676a7 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1" status: 200 len: 1313 microversion: 2.1 time: 0.163524 Aug 24 07:41:42.377687 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 103/195] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:42 2022] GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:42.404893 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-e00af78b-0e0d-47c5-8af7-1f236d73cbaf tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:42.405601 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-e00af78b-0e0d-47c5-8af7-1f236d73cbaf tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:42.411571 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e00af78b-0e0d-47c5-8af7-1f236d73cbaf tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:42.412048 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e00af78b-0e0d-47c5-8af7-1f236d73cbaf tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:42.412470 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e00af78b-0e0d-47c5-8af7-1f236d73cbaf tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:42.413243 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e00af78b-0e0d-47c5-8af7-1f236d73cbaf tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:42.413584 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e00af78b-0e0d-47c5-8af7-1f236d73cbaf tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:42.413984 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e00af78b-0e0d-47c5-8af7-1f236d73cbaf tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:42.559033 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-e00af78b-0e0d-47c5-8af7-1f236d73cbaf tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:42.567675 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-e00af78b-0e0d-47c5-8af7-1f236d73cbaf tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1522 microversion: 2.1 time: 0.167067 Aug 24 07:41:42.568241 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 93/196] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:42 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:41:43.100218 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-7968503f-2678-48c9-8c54-f7b71d7dfb54 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:43.101227 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-7968503f-2678-48c9-8c54-f7b71d7dfb54 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: d596e142-eb18-49d4-8eb8-bec422282059] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:43.108379 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7968503f-2678-48c9-8c54-f7b71d7dfb54 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:43.108867 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7968503f-2678-48c9-8c54-f7b71d7dfb54 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:43.109297 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7968503f-2678-48c9-8c54-f7b71d7dfb54 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:43.110199 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7968503f-2678-48c9-8c54-f7b71d7dfb54 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:43.110647 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7968503f-2678-48c9-8c54-f7b71d7dfb54 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:43.111332 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7968503f-2678-48c9-8c54-f7b71d7dfb54 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:43.266782 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-7968503f-2678-48c9-8c54-f7b71d7dfb54 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:43.276464 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-7968503f-2678-48c9-8c54-f7b71d7dfb54 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/d596e142-eb18-49d4-8eb8-bec422282059" status: 200 len: 1367 microversion: 2.1 time: 0.182609 Aug 24 07:41:43.277040 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 104/197] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:43 2022] GET /compute/v2.1/servers/d596e142-eb18-49d4-8eb8-bec422282059 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:43.411056 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-ae2be0c4-20ae-474b-9d4c-8af934369e3d tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:43.413853 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-ae2be0c4-20ae-474b-9d4c-8af934369e3d tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 595e5cfe-e53e-40d4-8841-cbc65440f5f1] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:43.421930 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ae2be0c4-20ae-474b-9d4c-8af934369e3d tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:43.422571 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ae2be0c4-20ae-474b-9d4c-8af934369e3d tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:43.423234 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ae2be0c4-20ae-474b-9d4c-8af934369e3d tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:43.424112 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ae2be0c4-20ae-474b-9d4c-8af934369e3d tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:43.424566 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ae2be0c4-20ae-474b-9d4c-8af934369e3d tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:43.425223 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ae2be0c4-20ae-474b-9d4c-8af934369e3d tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:43.595760 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-7cbc9675-7363-4f2a-a61e-a9f35697b02d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:43.599010 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-7cbc9675-7363-4f2a-a61e-a9f35697b02d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:43.604387 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-ae2be0c4-20ae-474b-9d4c-8af934369e3d tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:43.605516 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7cbc9675-7363-4f2a-a61e-a9f35697b02d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:43.606004 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7cbc9675-7363-4f2a-a61e-a9f35697b02d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:43.606431 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7cbc9675-7363-4f2a-a61e-a9f35697b02d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:43.607195 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7cbc9675-7363-4f2a-a61e-a9f35697b02d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:43.607642 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7cbc9675-7363-4f2a-a61e-a9f35697b02d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:43.608297 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7cbc9675-7363-4f2a-a61e-a9f35697b02d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:43.612450 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-ae2be0c4-20ae-474b-9d4c-8af934369e3d tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1" status: 200 len: 1313 microversion: 2.1 time: 0.217452 Aug 24 07:41:43.613610 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 94/198] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:43 2022] GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1 => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:43.798736 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-7cbc9675-7363-4f2a-a61e-a9f35697b02d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:43.810181 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-7cbc9675-7363-4f2a-a61e-a9f35697b02d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1522 microversion: 2.1 time: 0.218681 Aug 24 07:41:43.810728 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 105/199] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:43 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:44.298453 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-e939b531-ea0f-4cbc-b056-0d02b5c6481e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:44.299112 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-e939b531-ea0f-4cbc-b056-0d02b5c6481e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: d596e142-eb18-49d4-8eb8-bec422282059] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:44.300981 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell0:SELECT=2 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:41:44.309829 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e939b531-ea0f-4cbc-b056-0d02b5c6481e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:44.310177 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e939b531-ea0f-4cbc-b056-0d02b5c6481e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:44.310605 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e939b531-ea0f-4cbc-b056-0d02b5c6481e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:44.311401 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e939b531-ea0f-4cbc-b056-0d02b5c6481e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:44.311822 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e939b531-ea0f-4cbc-b056-0d02b5c6481e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:44.312185 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e939b531-ea0f-4cbc-b056-0d02b5c6481e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:44.464730 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-e939b531-ea0f-4cbc-b056-0d02b5c6481e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:44.475318 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-e939b531-ea0f-4cbc-b056-0d02b5c6481e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/d596e142-eb18-49d4-8eb8-bec422282059" status: 200 len: 1367 microversion: 2.1 time: 0.181681 Aug 24 07:41:44.476375 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 95/200] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:44 2022] GET /compute/v2.1/servers/d596e142-eb18-49d4-8eb8-bec422282059 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:44.633841 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-bb06008f-e7f1-4804-bd86-e9c1cc9adc76 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:44.635386 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-bb06008f-e7f1-4804-bd86-e9c1cc9adc76 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 595e5cfe-e53e-40d4-8841-cbc65440f5f1] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:44.638844 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:41:44.644174 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-bb06008f-e7f1-4804-bd86-e9c1cc9adc76 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:44.644655 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-bb06008f-e7f1-4804-bd86-e9c1cc9adc76 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:44.645256 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-bb06008f-e7f1-4804-bd86-e9c1cc9adc76 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:44.645926 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-bb06008f-e7f1-4804-bd86-e9c1cc9adc76 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:44.646367 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-bb06008f-e7f1-4804-bd86-e9c1cc9adc76 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:44.647006 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-bb06008f-e7f1-4804-bd86-e9c1cc9adc76 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:44.710358 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [req-ead13235-df98-4958-a5f1-1308b0c06e84 req-b8dfa4e9-32d5-4552-9992-7fbce75517f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d596e142-eb18-49d4-8eb8-bec422282059", "name": "network-vif-plugged", "status": "completed", "tag": "8feec3b6-e865-473e-bce9-488008443570"}]} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:41:44.724373 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-ead13235-df98-4958-a5f1-1308b0c06e84 req-b8dfa4e9-32d5-4552-9992-7fbce75517f0 service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:44.724839 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-ead13235-df98-4958-a5f1-1308b0c06e84 req-b8dfa4e9-32d5-4552-9992-7fbce75517f0 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:44.725343 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-ead13235-df98-4958-a5f1-1308b0c06e84 req-b8dfa4e9-32d5-4552-9992-7fbce75517f0 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:44.745968 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.compute.server_external_events [req-ead13235-df98-4958-a5f1-1308b0c06e84 req-b8dfa4e9-32d5-4552-9992-7fbce75517f0 service nova] Creating event network-vif-plugged:8feec3b6-e865-473e-bce9-488008443570 for instance d596e142-eb18-49d4-8eb8-bec422282059 on hv-cinder-85427 Aug 24 07:41:44.756644 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [req-ead13235-df98-4958-a5f1-1308b0c06e84 req-b8dfa4e9-32d5-4552-9992-7fbce75517f0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050470 Aug 24 07:41:44.757906 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 96/201] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:41:44.816369 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-bb06008f-e7f1-4804-bd86-e9c1cc9adc76 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:44.827305 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-bb06008f-e7f1-4804-bd86-e9c1cc9adc76 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1" status: 200 len: 1313 microversion: 2.1 time: 0.197260 Aug 24 07:41:44.828339 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 106/202] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:44 2022] GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1 => generated 1313 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:44.849197 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-6b3803bf-d2f0-4c6e-a1a0-b4e9e9f5537c tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:44.849815 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-6b3803bf-d2f0-4c6e-a1a0-b4e9e9f5537c tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:44.857132 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6b3803bf-d2f0-4c6e-a1a0-b4e9e9f5537c tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:44.857691 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6b3803bf-d2f0-4c6e-a1a0-b4e9e9f5537c tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:44.858126 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6b3803bf-d2f0-4c6e-a1a0-b4e9e9f5537c tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:44.859025 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6b3803bf-d2f0-4c6e-a1a0-b4e9e9f5537c tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:44.859627 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6b3803bf-d2f0-4c6e-a1a0-b4e9e9f5537c tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:44.860231 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6b3803bf-d2f0-4c6e-a1a0-b4e9e9f5537c tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:45.053043 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-6b3803bf-d2f0-4c6e-a1a0-b4e9e9f5537c tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:45.074656 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-6b3803bf-d2f0-4c6e-a1a0-b4e9e9f5537c tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1522 microversion: 2.1 time: 0.246383 Aug 24 07:41:45.075535 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 97/203] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:44 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:45.242809 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-66fc9769-0b52-400b-9c10-2964b091910a tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a82f9834-0f0f-406e-8263-658914370081"}} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:41:45.245311 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-66fc9769-0b52-400b-9c10-2964b091910a tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:45.251738 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-66fc9769-0b52-400b-9c10-2964b091910a tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:45.252214 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-66fc9769-0b52-400b-9c10-2964b091910a tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:45.252645 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-66fc9769-0b52-400b-9c10-2964b091910a tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:45.253327 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-66fc9769-0b52-400b-9c10-2964b091910a tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:45.253782 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-66fc9769-0b52-400b-9c10-2964b091910a tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:45.254203 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-66fc9769-0b52-400b-9c10-2964b091910a tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:45.506770 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-c8661fc2-9f4d-444b-b30a-b225960fcd47 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:45.506770 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-c8661fc2-9f4d-444b-b30a-b225960fcd47 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: d596e142-eb18-49d4-8eb8-bec422282059] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:45.513078 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c8661fc2-9f4d-444b-b30a-b225960fcd47 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:45.517006 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c8661fc2-9f4d-444b-b30a-b225960fcd47 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:45.520297 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c8661fc2-9f4d-444b-b30a-b225960fcd47 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:45.521404 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c8661fc2-9f4d-444b-b30a-b225960fcd47 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:45.525437 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c8661fc2-9f4d-444b-b30a-b225960fcd47 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:45.525968 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c8661fc2-9f4d-444b-b30a-b225960fcd47 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:45.666133 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-66fc9769-0b52-400b-9c10-2964b091910a tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "POST /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.426666 Aug 24 07:41:45.669688 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 107/204] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Aug 24 07:41:45 2022] POST /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c/os-volume_attachments => generated 194 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:41:45.775759 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-c8661fc2-9f4d-444b-b30a-b225960fcd47 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:45.784549 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-c8661fc2-9f4d-444b-b30a-b225960fcd47 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/d596e142-eb18-49d4-8eb8-bec422282059" status: 200 len: 1367 microversion: 2.1 time: 0.291002 Aug 24 07:41:45.785297 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 98/205] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:45 2022] GET /compute/v2.1/servers/d596e142-eb18-49d4-8eb8-bec422282059 => generated 1367 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:41:45.858666 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-fbf8f70f-6bde-4456-965a-3e9aef1e6ce3 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:45.859666 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-fbf8f70f-6bde-4456-965a-3e9aef1e6ce3 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 595e5cfe-e53e-40d4-8841-cbc65440f5f1] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:45.866970 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fbf8f70f-6bde-4456-965a-3e9aef1e6ce3 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:45.867441 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fbf8f70f-6bde-4456-965a-3e9aef1e6ce3 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:45.867883 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fbf8f70f-6bde-4456-965a-3e9aef1e6ce3 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:45.868566 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fbf8f70f-6bde-4456-965a-3e9aef1e6ce3 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:45.869011 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fbf8f70f-6bde-4456-965a-3e9aef1e6ce3 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:45.869426 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fbf8f70f-6bde-4456-965a-3e9aef1e6ce3 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:46.017957 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-fbf8f70f-6bde-4456-965a-3e9aef1e6ce3 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:46.025902 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-fbf8f70f-6bde-4456-965a-3e9aef1e6ce3 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1" status: 200 len: 1313 microversion: 2.1 time: 0.173064 Aug 24 07:41:46.026473 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 108/206] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:45 2022] GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1 => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:46.097019 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-136815ea-e734-43d7-a7a0-3b3271eacaab tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:46.098128 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-136815ea-e734-43d7-a7a0-3b3271eacaab tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:46.105729 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-136815ea-e734-43d7-a7a0-3b3271eacaab tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:46.106229 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-136815ea-e734-43d7-a7a0-3b3271eacaab tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:46.106666 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-136815ea-e734-43d7-a7a0-3b3271eacaab tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:46.111825 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-136815ea-e734-43d7-a7a0-3b3271eacaab tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:46.112387 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-136815ea-e734-43d7-a7a0-3b3271eacaab tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:46.112907 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-136815ea-e734-43d7-a7a0-3b3271eacaab tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:46.264832 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-136815ea-e734-43d7-a7a0-3b3271eacaab tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:46.272507 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-136815ea-e734-43d7-a7a0-3b3271eacaab tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1522 microversion: 2.1 time: 0.179667 Aug 24 07:41:46.273069 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 99/207] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:46 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:46.810397 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-6e5f0317-1b8b-4612-b228-08b832bb3fc9 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:46.812411 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-6e5f0317-1b8b-4612-b228-08b832bb3fc9 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: d596e142-eb18-49d4-8eb8-bec422282059] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:46.826782 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell0:SELECT=2 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:41:46.827947 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell0:SELECT=10 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:41:46.831449 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6e5f0317-1b8b-4612-b228-08b832bb3fc9 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:46.831933 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6e5f0317-1b8b-4612-b228-08b832bb3fc9 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:46.832361 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6e5f0317-1b8b-4612-b228-08b832bb3fc9 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:46.835397 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6e5f0317-1b8b-4612-b228-08b832bb3fc9 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:46.835863 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6e5f0317-1b8b-4612-b228-08b832bb3fc9 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:46.838021 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6e5f0317-1b8b-4612-b228-08b832bb3fc9 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:47.007050 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-6e5f0317-1b8b-4612-b228-08b832bb3fc9 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:47.016374 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-6e5f0317-1b8b-4612-b228-08b832bb3fc9 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/d596e142-eb18-49d4-8eb8-bec422282059" status: 200 len: 1367 microversion: 2.1 time: 0.214469 Aug 24 07:41:47.017581 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 109/208] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:46 2022] GET /compute/v2.1/servers/d596e142-eb18-49d4-8eb8-bec422282059 => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:47.047029 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-27b5f4f8-a3cc-4cf7-bd4f-3ea5229e12cb tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:47.048100 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-27b5f4f8-a3cc-4cf7-bd4f-3ea5229e12cb tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 595e5cfe-e53e-40d4-8841-cbc65440f5f1] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:47.050224 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell0:SELECT=10 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:41:47.056298 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-27b5f4f8-a3cc-4cf7-bd4f-3ea5229e12cb tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:47.056780 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-27b5f4f8-a3cc-4cf7-bd4f-3ea5229e12cb tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:47.057615 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-27b5f4f8-a3cc-4cf7-bd4f-3ea5229e12cb tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:47.058359 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-27b5f4f8-a3cc-4cf7-bd4f-3ea5229e12cb tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:47.058944 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-27b5f4f8-a3cc-4cf7-bd4f-3ea5229e12cb tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:47.059366 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-27b5f4f8-a3cc-4cf7-bd4f-3ea5229e12cb tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:47.195162 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-27b5f4f8-a3cc-4cf7-bd4f-3ea5229e12cb tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:47.202573 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-27b5f4f8-a3cc-4cf7-bd4f-3ea5229e12cb tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1" status: 200 len: 1313 microversion: 2.1 time: 0.159812 Aug 24 07:41:47.203154 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 100/209] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:47 2022] GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:47.293333 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-d972477f-2ac3-4f69-a28a-2d3834868446 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:47.293998 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-d972477f-2ac3-4f69-a28a-2d3834868446 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:47.300673 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d972477f-2ac3-4f69-a28a-2d3834868446 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:47.301280 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d972477f-2ac3-4f69-a28a-2d3834868446 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:47.301699 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d972477f-2ac3-4f69-a28a-2d3834868446 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:47.302432 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d972477f-2ac3-4f69-a28a-2d3834868446 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:47.302972 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d972477f-2ac3-4f69-a28a-2d3834868446 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:47.303405 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d972477f-2ac3-4f69-a28a-2d3834868446 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:47.439471 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-d972477f-2ac3-4f69-a28a-2d3834868446 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:47.448915 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-d972477f-2ac3-4f69-a28a-2d3834868446 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1522 microversion: 2.1 time: 0.159362 Aug 24 07:41:47.449593 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 110/210] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:47 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:48.041996 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-a7bd5c13-72b7-4e00-9a8d-42ef4ffb5109 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:48.042590 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-a7bd5c13-72b7-4e00-9a8d-42ef4ffb5109 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: d596e142-eb18-49d4-8eb8-bec422282059] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:48.049450 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a7bd5c13-72b7-4e00-9a8d-42ef4ffb5109 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:48.050753 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a7bd5c13-72b7-4e00-9a8d-42ef4ffb5109 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:48.051401 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a7bd5c13-72b7-4e00-9a8d-42ef4ffb5109 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:48.052508 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a7bd5c13-72b7-4e00-9a8d-42ef4ffb5109 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:48.053098 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a7bd5c13-72b7-4e00-9a8d-42ef4ffb5109 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:48.053652 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a7bd5c13-72b7-4e00-9a8d-42ef4ffb5109 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:48.216770 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-a7bd5c13-72b7-4e00-9a8d-42ef4ffb5109 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:48.224405 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-93f9453f-651e-435e-ad1d-c3af3e26ed75 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:48.225157 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-93f9453f-651e-435e-ad1d-c3af3e26ed75 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 595e5cfe-e53e-40d4-8841-cbc65440f5f1] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:48.228051 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-a7bd5c13-72b7-4e00-9a8d-42ef4ffb5109 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/d596e142-eb18-49d4-8eb8-bec422282059" status: 200 len: 1557 microversion: 2.1 time: 0.190368 Aug 24 07:41:48.228653 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 101/211] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:48 2022] GET /compute/v2.1/servers/d596e142-eb18-49d4-8eb8-bec422282059 => generated 1557 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:48.241528 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-93f9453f-651e-435e-ad1d-c3af3e26ed75 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:48.242834 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-93f9453f-651e-435e-ad1d-c3af3e26ed75 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:48.243643 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-93f9453f-651e-435e-ad1d-c3af3e26ed75 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:48.244801 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-93f9453f-651e-435e-ad1d-c3af3e26ed75 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:48.245560 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-93f9453f-651e-435e-ad1d-c3af3e26ed75 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:48.246363 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-93f9453f-651e-435e-ad1d-c3af3e26ed75 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:48.252901 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-148e0e62-c7f3-42e1-ba51-1f7d2b0db885 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:48.253489 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-148e0e62-c7f3-42e1-ba51-1f7d2b0db885 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: d596e142-eb18-49d4-8eb8-bec422282059] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:48.259787 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-148e0e62-c7f3-42e1-ba51-1f7d2b0db885 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:48.260283 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-148e0e62-c7f3-42e1-ba51-1f7d2b0db885 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:48.260731 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-148e0e62-c7f3-42e1-ba51-1f7d2b0db885 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:48.261425 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-148e0e62-c7f3-42e1-ba51-1f7d2b0db885 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:48.261888 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-148e0e62-c7f3-42e1-ba51-1f7d2b0db885 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:48.262307 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-148e0e62-c7f3-42e1-ba51-1f7d2b0db885 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:48.405779 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-148e0e62-c7f3-42e1-ba51-1f7d2b0db885 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/d596e142-eb18-49d4-8eb8-bec422282059/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.157746 Aug 24 07:41:48.406378 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 102/212] 10.222.0.42 () {58 vars in 1275 bytes} [Wed Aug 24 07:41:48 2022] GET /compute/v2.1/servers/d596e142-eb18-49d4-8eb8-bec422282059/os-interface => generated 284 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:41:48.440239 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-93f9453f-651e-435e-ad1d-c3af3e26ed75 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:48.448149 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-93f9453f-651e-435e-ad1d-c3af3e26ed75 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1" status: 200 len: 1313 microversion: 2.1 time: 0.227705 Aug 24 07:41:48.448895 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 111/213] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:48 2022] GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1 => generated 1313 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:48.473053 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-44fdbae1-6908-4f74-b4cd-4bb4e95a3bef tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:48.473667 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-44fdbae1-6908-4f74-b4cd-4bb4e95a3bef tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:48.480398 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-44fdbae1-6908-4f74-b4cd-4bb4e95a3bef tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:48.481568 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-44fdbae1-6908-4f74-b4cd-4bb4e95a3bef tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:48.482054 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-44fdbae1-6908-4f74-b4cd-4bb4e95a3bef tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:48.483137 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-44fdbae1-6908-4f74-b4cd-4bb4e95a3bef tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:48.483692 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-44fdbae1-6908-4f74-b4cd-4bb4e95a3bef tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:48.484297 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-44fdbae1-6908-4f74-b4cd-4bb4e95a3bef tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:48.793722 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-44fdbae1-6908-4f74-b4cd-4bb4e95a3bef tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:48.802720 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-44fdbae1-6908-4f74-b4cd-4bb4e95a3bef tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1522 microversion: 2.1 time: 0.335320 Aug 24 07:41:48.803320 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 103/214] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:48 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1522 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:49.473588 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-05920a7f-0070-444e-b824-a06740424b1f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:49.474232 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-05920a7f-0070-444e-b824-a06740424b1f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 595e5cfe-e53e-40d4-8841-cbc65440f5f1] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:49.484231 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-05920a7f-0070-444e-b824-a06740424b1f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:49.484804 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-05920a7f-0070-444e-b824-a06740424b1f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:49.486656 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-05920a7f-0070-444e-b824-a06740424b1f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:49.486656 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-05920a7f-0070-444e-b824-a06740424b1f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:49.486656 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-05920a7f-0070-444e-b824-a06740424b1f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:49.487189 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-05920a7f-0070-444e-b824-a06740424b1f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:49.647343 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-05920a7f-0070-444e-b824-a06740424b1f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:49.658051 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-05920a7f-0070-444e-b824-a06740424b1f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1" status: 200 len: 1313 microversion: 2.1 time: 0.192186 Aug 24 07:41:49.675394 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 112/215] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:49 2022] GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1 => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:49.739856 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [req-99b5331f-14ae-456b-8753-04a1ec5a199a req-6413b841-89a9-4ad1-80d4-24c7e4b15fcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d596e142-eb18-49d4-8eb8-bec422282059", "tag": "8feec3b6-e865-473e-bce9-488008443570"}]} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:41:49.749103 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-99b5331f-14ae-456b-8753-04a1ec5a199a req-6413b841-89a9-4ad1-80d4-24c7e4b15fcb service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:49.749580 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-99b5331f-14ae-456b-8753-04a1ec5a199a req-6413b841-89a9-4ad1-80d4-24c7e4b15fcb service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:49.750007 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-99b5331f-14ae-456b-8753-04a1ec5a199a req-6413b841-89a9-4ad1-80d4-24c7e4b15fcb service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:49.762248 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.compute.server_external_events [req-99b5331f-14ae-456b-8753-04a1ec5a199a req-6413b841-89a9-4ad1-80d4-24c7e4b15fcb service nova] Creating event network-changed:8feec3b6-e865-473e-bce9-488008443570 for instance d596e142-eb18-49d4-8eb8-bec422282059 on hv-cinder-85427 Aug 24 07:41:49.768448 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [req-99b5331f-14ae-456b-8753-04a1ec5a199a req-6413b841-89a9-4ad1-80d4-24c7e4b15fcb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033734 Aug 24 07:41:49.769070 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 104/216] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:41:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:41:49.825891 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-17d9aa8d-8a2a-4bfc-b714-abb49750a6b3 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:49.826487 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-17d9aa8d-8a2a-4bfc-b714-abb49750a6b3 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:49.834276 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-17d9aa8d-8a2a-4bfc-b714-abb49750a6b3 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:49.835197 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-17d9aa8d-8a2a-4bfc-b714-abb49750a6b3 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:49.835789 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-17d9aa8d-8a2a-4bfc-b714-abb49750a6b3 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:49.836720 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-17d9aa8d-8a2a-4bfc-b714-abb49750a6b3 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:49.837400 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-17d9aa8d-8a2a-4bfc-b714-abb49750a6b3 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:49.838039 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-17d9aa8d-8a2a-4bfc-b714-abb49750a6b3 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:50.174104 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-17d9aa8d-8a2a-4bfc-b714-abb49750a6b3 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:50.182196 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-17d9aa8d-8a2a-4bfc-b714-abb49750a6b3 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1522 microversion: 2.1 time: 0.360065 Aug 24 07:41:50.182847 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 113/217] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:49 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1522 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:41:50.689871 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-5940e996-8ab1-4ac1-9e00-279e1967bfff tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:50.690575 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-5940e996-8ab1-4ac1-9e00-279e1967bfff tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 595e5cfe-e53e-40d4-8841-cbc65440f5f1] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:50.698748 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5940e996-8ab1-4ac1-9e00-279e1967bfff tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:50.699323 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5940e996-8ab1-4ac1-9e00-279e1967bfff tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:50.699818 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5940e996-8ab1-4ac1-9e00-279e1967bfff tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:50.700743 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5940e996-8ab1-4ac1-9e00-279e1967bfff tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:50.701266 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5940e996-8ab1-4ac1-9e00-279e1967bfff tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:50.702269 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5940e996-8ab1-4ac1-9e00-279e1967bfff tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:50.867819 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-5940e996-8ab1-4ac1-9e00-279e1967bfff tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:50.875756 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-5940e996-8ab1-4ac1-9e00-279e1967bfff tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1" status: 200 len: 1313 microversion: 2.1 time: 0.195632 Aug 24 07:41:50.876324 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 105/218] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:50 2022] GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1 => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:51.205313 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-40fb4c63-aad7-43ab-9056-202de40ebdc9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:51.205948 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-40fb4c63-aad7-43ab-9056-202de40ebdc9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:51.212427 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-40fb4c63-aad7-43ab-9056-202de40ebdc9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:51.212939 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-40fb4c63-aad7-43ab-9056-202de40ebdc9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:51.213369 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-40fb4c63-aad7-43ab-9056-202de40ebdc9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:51.214054 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-40fb4c63-aad7-43ab-9056-202de40ebdc9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:51.214502 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-40fb4c63-aad7-43ab-9056-202de40ebdc9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:51.214942 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-40fb4c63-aad7-43ab-9056-202de40ebdc9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:51.234634 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:41:51.352007 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-40fb4c63-aad7-43ab-9056-202de40ebdc9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:51.359544 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-40fb4c63-aad7-43ab-9056-202de40ebdc9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1522 microversion: 2.1 time: 0.158841 Aug 24 07:41:51.360629 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 114/219] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:51 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:51.897961 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-ebaa5a06-64a1-491e-a363-00d8962af50e tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:51.898554 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-ebaa5a06-64a1-491e-a363-00d8962af50e tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 595e5cfe-e53e-40d4-8841-cbc65440f5f1] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:51.904518 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ebaa5a06-64a1-491e-a363-00d8962af50e tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:51.904999 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ebaa5a06-64a1-491e-a363-00d8962af50e tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:51.905429 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ebaa5a06-64a1-491e-a363-00d8962af50e tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:51.906110 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ebaa5a06-64a1-491e-a363-00d8962af50e tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:51.906560 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ebaa5a06-64a1-491e-a363-00d8962af50e tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:51.907528 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ebaa5a06-64a1-491e-a363-00d8962af50e tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:52.041405 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-ebaa5a06-64a1-491e-a363-00d8962af50e tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:52.048996 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-ebaa5a06-64a1-491e-a363-00d8962af50e tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1" status: 200 len: 1313 microversion: 2.1 time: 0.154857 Aug 24 07:41:52.049579 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 106/220] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:51 2022] GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:52.381532 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-edc5c0fe-0c09-4808-bc66-c97790c6bb2f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:52.382793 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-edc5c0fe-0c09-4808-bc66-c97790c6bb2f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:52.388336 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-edc5c0fe-0c09-4808-bc66-c97790c6bb2f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:52.388895 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-edc5c0fe-0c09-4808-bc66-c97790c6bb2f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:52.389232 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-edc5c0fe-0c09-4808-bc66-c97790c6bb2f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:52.389910 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-edc5c0fe-0c09-4808-bc66-c97790c6bb2f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:52.390356 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-edc5c0fe-0c09-4808-bc66-c97790c6bb2f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:52.390800 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-edc5c0fe-0c09-4808-bc66-c97790c6bb2f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:52.535376 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-edc5c0fe-0c09-4808-bc66-c97790c6bb2f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:52.543227 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-edc5c0fe-0c09-4808-bc66-c97790c6bb2f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1522 microversion: 2.1 time: 0.165851 Aug 24 07:41:52.543821 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 115/221] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:52 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:53.071241 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-cd5c2ab7-9bda-45da-9bd1-44097576183a tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:53.071836 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-cd5c2ab7-9bda-45da-9bd1-44097576183a tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 595e5cfe-e53e-40d4-8841-cbc65440f5f1] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:53.077630 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-cd5c2ab7-9bda-45da-9bd1-44097576183a tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:53.078096 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-cd5c2ab7-9bda-45da-9bd1-44097576183a tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:53.078860 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-cd5c2ab7-9bda-45da-9bd1-44097576183a tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:53.079860 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-cd5c2ab7-9bda-45da-9bd1-44097576183a tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:53.080306 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-cd5c2ab7-9bda-45da-9bd1-44097576183a tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:53.080935 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-cd5c2ab7-9bda-45da-9bd1-44097576183a tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:53.215266 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-cd5c2ab7-9bda-45da-9bd1-44097576183a tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:53.227266 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-cd5c2ab7-9bda-45da-9bd1-44097576183a tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1" status: 200 len: 1313 microversion: 2.1 time: 0.160047 Aug 24 07:41:53.227840 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 107/222] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:53 2022] GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:41:53.292882 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-f5aaa0c4-f49f-4ed4-98bd-58234f0807ac tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:41:53.299437 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f5aaa0c4-f49f-4ed4-98bd-58234f0807ac tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:53.299938 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f5aaa0c4-f49f-4ed4-98bd-58234f0807ac tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:53.300364 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f5aaa0c4-f49f-4ed4-98bd-58234f0807ac tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:53.358952 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-f5aaa0c4-f49f-4ed4-98bd-58234f0807ac tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Going to try to stop instance {{(pid=127114) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 07:41:53.404144 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-f5aaa0c4-f49f-4ed4-98bd-58234f0807ac tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "POST /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c/action" status: 202 len: 0 microversion: 2.1 time: 0.114890 Aug 24 07:41:53.405290 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 116/223] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 24 07:41:53 2022] POST /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 07:41:53.414018 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-101cd628-7850-485d-8206-cdcd8ec30594 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:53.414862 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-101cd628-7850-485d-8206-cdcd8ec30594 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:53.421449 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-101cd628-7850-485d-8206-cdcd8ec30594 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:53.422015 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-101cd628-7850-485d-8206-cdcd8ec30594 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:53.422518 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-101cd628-7850-485d-8206-cdcd8ec30594 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:53.423869 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-101cd628-7850-485d-8206-cdcd8ec30594 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:53.424324 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-101cd628-7850-485d-8206-cdcd8ec30594 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:53.424822 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-101cd628-7850-485d-8206-cdcd8ec30594 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:53.560443 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-101cd628-7850-485d-8206-cdcd8ec30594 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:53.565692 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-64e215c3-9b77-4325-91a4-391833fba527 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:53.565861 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-64e215c3-9b77-4325-91a4-391833fba527 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:53.569345 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-101cd628-7850-485d-8206-cdcd8ec30594 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 200 len: 1722 microversion: 2.1 time: 0.159400 Aug 24 07:41:53.569933 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 108/224] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:53 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:41:53.576716 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-64e215c3-9b77-4325-91a4-391833fba527 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:53.577212 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-64e215c3-9b77-4325-91a4-391833fba527 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:53.577681 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-64e215c3-9b77-4325-91a4-391833fba527 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:53.579675 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-64e215c3-9b77-4325-91a4-391833fba527 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:53.584801 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-64e215c3-9b77-4325-91a4-391833fba527 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:53.584801 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-64e215c3-9b77-4325-91a4-391833fba527 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:53.852678 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-64e215c3-9b77-4325-91a4-391833fba527 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:53.860646 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-64e215c3-9b77-4325-91a4-391833fba527 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1522 microversion: 2.1 time: 0.300030 Aug 24 07:41:53.861228 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 117/225] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:53 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:41:54.249757 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-902d6cbb-adea-452b-91a9-0da7a53ad9b6 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:54.250450 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-902d6cbb-adea-452b-91a9-0da7a53ad9b6 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 595e5cfe-e53e-40d4-8841-cbc65440f5f1] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:54.257410 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-902d6cbb-adea-452b-91a9-0da7a53ad9b6 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:54.257945 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-902d6cbb-adea-452b-91a9-0da7a53ad9b6 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:54.258375 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-902d6cbb-adea-452b-91a9-0da7a53ad9b6 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:54.259082 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-902d6cbb-adea-452b-91a9-0da7a53ad9b6 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:54.259523 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-902d6cbb-adea-452b-91a9-0da7a53ad9b6 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:54.259933 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-902d6cbb-adea-452b-91a9-0da7a53ad9b6 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:54.397950 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-902d6cbb-adea-452b-91a9-0da7a53ad9b6 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:54.401821 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell1:SELECT=100 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:41:54.407605 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-902d6cbb-adea-452b-91a9-0da7a53ad9b6 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1" status: 200 len: 1313 microversion: 2.1 time: 0.161986 Aug 24 07:41:54.408174 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 109/226] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:54 2022] GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:54.591633 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-750bdefa-e43d-448f-9282-9ebb770a6eda tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:54.592329 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-750bdefa-e43d-448f-9282-9ebb770a6eda tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:54.600302 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-750bdefa-e43d-448f-9282-9ebb770a6eda tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:54.600785 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-750bdefa-e43d-448f-9282-9ebb770a6eda tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:54.601231 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-750bdefa-e43d-448f-9282-9ebb770a6eda tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:54.601917 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-750bdefa-e43d-448f-9282-9ebb770a6eda tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:54.602393 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-750bdefa-e43d-448f-9282-9ebb770a6eda tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:54.602842 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-750bdefa-e43d-448f-9282-9ebb770a6eda tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:54.737854 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-750bdefa-e43d-448f-9282-9ebb770a6eda tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:54.746004 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-750bdefa-e43d-448f-9282-9ebb770a6eda tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 200 len: 1722 microversion: 2.1 time: 0.158719 Aug 24 07:41:54.746574 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 118/227] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:54 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:54.881506 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-af198653-f5cc-47dd-bcac-8fc09d510307 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:54.882103 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-af198653-f5cc-47dd-bcac-8fc09d510307 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:54.887952 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-af198653-f5cc-47dd-bcac-8fc09d510307 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:54.888423 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-af198653-f5cc-47dd-bcac-8fc09d510307 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:54.888843 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-af198653-f5cc-47dd-bcac-8fc09d510307 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:54.889602 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-af198653-f5cc-47dd-bcac-8fc09d510307 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:54.890039 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-af198653-f5cc-47dd-bcac-8fc09d510307 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:54.890450 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-af198653-f5cc-47dd-bcac-8fc09d510307 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:55.028235 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-af198653-f5cc-47dd-bcac-8fc09d510307 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:55.035841 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-af198653-f5cc-47dd-bcac-8fc09d510307 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1522 microversion: 2.1 time: 0.158332 Aug 24 07:41:55.036403 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 110/228] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:54 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:55.429174 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-0ce7b55c-fbbf-425b-aeb3-f195a357c1eb tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:55.430025 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-0ce7b55c-fbbf-425b-aeb3-f195a357c1eb tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 595e5cfe-e53e-40d4-8841-cbc65440f5f1] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:55.435920 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0ce7b55c-fbbf-425b-aeb3-f195a357c1eb tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:55.436389 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0ce7b55c-fbbf-425b-aeb3-f195a357c1eb tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:55.436815 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0ce7b55c-fbbf-425b-aeb3-f195a357c1eb tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:55.437481 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0ce7b55c-fbbf-425b-aeb3-f195a357c1eb tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:55.437935 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0ce7b55c-fbbf-425b-aeb3-f195a357c1eb tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:55.438347 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0ce7b55c-fbbf-425b-aeb3-f195a357c1eb tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:55.570156 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-0ce7b55c-fbbf-425b-aeb3-f195a357c1eb tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:55.577745 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-0ce7b55c-fbbf-425b-aeb3-f195a357c1eb tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1" status: 200 len: 1313 microversion: 2.1 time: 0.152400 Aug 24 07:41:55.578305 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 119/229] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:55 2022] GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:55.766835 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-9e261ded-c4f9-4759-95f1-fdc6be9a3b53 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:55.768066 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-9e261ded-c4f9-4759-95f1-fdc6be9a3b53 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:55.773864 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9e261ded-c4f9-4759-95f1-fdc6be9a3b53 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:55.774340 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9e261ded-c4f9-4759-95f1-fdc6be9a3b53 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:55.774798 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9e261ded-c4f9-4759-95f1-fdc6be9a3b53 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:55.775553 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9e261ded-c4f9-4759-95f1-fdc6be9a3b53 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:55.775906 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9e261ded-c4f9-4759-95f1-fdc6be9a3b53 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:55.776325 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9e261ded-c4f9-4759-95f1-fdc6be9a3b53 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:55.914150 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-9e261ded-c4f9-4759-95f1-fdc6be9a3b53 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:55.922221 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-9e261ded-c4f9-4759-95f1-fdc6be9a3b53 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 200 len: 1722 microversion: 2.1 time: 0.159196 Aug 24 07:41:55.922802 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 111/230] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:55 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:56.059441 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-ff89b711-9523-48f3-a67a-9ecd94fc7745 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:56.060226 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-ff89b711-9523-48f3-a67a-9ecd94fc7745 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:56.070193 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ff89b711-9523-48f3-a67a-9ecd94fc7745 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:56.070763 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ff89b711-9523-48f3-a67a-9ecd94fc7745 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:56.071204 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ff89b711-9523-48f3-a67a-9ecd94fc7745 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:56.071942 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ff89b711-9523-48f3-a67a-9ecd94fc7745 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:56.072393 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ff89b711-9523-48f3-a67a-9ecd94fc7745 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:56.072812 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ff89b711-9523-48f3-a67a-9ecd94fc7745 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:56.198290 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-ff89b711-9523-48f3-a67a-9ecd94fc7745 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:56.205804 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-ff89b711-9523-48f3-a67a-9ecd94fc7745 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1522 microversion: 2.1 time: 0.152656 Aug 24 07:41:56.206362 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 120/231] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:56 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:56.600799 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-261d723d-6d16-4632-b3be-4f3e322a79a8 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:56.601409 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-261d723d-6d16-4632-b3be-4f3e322a79a8 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 595e5cfe-e53e-40d4-8841-cbc65440f5f1] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:56.607401 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-261d723d-6d16-4632-b3be-4f3e322a79a8 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:56.607883 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-261d723d-6d16-4632-b3be-4f3e322a79a8 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:56.608308 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-261d723d-6d16-4632-b3be-4f3e322a79a8 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:56.608992 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-261d723d-6d16-4632-b3be-4f3e322a79a8 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:56.609439 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-261d723d-6d16-4632-b3be-4f3e322a79a8 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:56.609852 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-261d723d-6d16-4632-b3be-4f3e322a79a8 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:56.741958 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-261d723d-6d16-4632-b3be-4f3e322a79a8 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:56.749409 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-261d723d-6d16-4632-b3be-4f3e322a79a8 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1" status: 200 len: 1313 microversion: 2.1 time: 0.152660 Aug 24 07:41:56.749958 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 112/232] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:56 2022] GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:56.943449 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-f5197079-d01e-45c3-99ab-3aac56de0f70 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:56.944603 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-f5197079-d01e-45c3-99ab-3aac56de0f70 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:56.950734 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f5197079-d01e-45c3-99ab-3aac56de0f70 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:56.951224 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f5197079-d01e-45c3-99ab-3aac56de0f70 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:56.951649 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f5197079-d01e-45c3-99ab-3aac56de0f70 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:56.952331 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f5197079-d01e-45c3-99ab-3aac56de0f70 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:56.952785 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f5197079-d01e-45c3-99ab-3aac56de0f70 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:56.953203 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f5197079-d01e-45c3-99ab-3aac56de0f70 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:57.090828 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-f5197079-d01e-45c3-99ab-3aac56de0f70 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:57.099406 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-f5197079-d01e-45c3-99ab-3aac56de0f70 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 200 len: 1722 microversion: 2.1 time: 0.160373 Aug 24 07:41:57.099960 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 121/233] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:56 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:57.226103 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-34c22864-0408-4252-bee0-c024941e2127 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:57.226715 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-34c22864-0408-4252-bee0-c024941e2127 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:57.232660 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-34c22864-0408-4252-bee0-c024941e2127 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:57.233152 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-34c22864-0408-4252-bee0-c024941e2127 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:57.233560 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-34c22864-0408-4252-bee0-c024941e2127 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:57.234235 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-34c22864-0408-4252-bee0-c024941e2127 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:57.234709 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-34c22864-0408-4252-bee0-c024941e2127 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:57.235128 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-34c22864-0408-4252-bee0-c024941e2127 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:57.366677 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-34c22864-0408-4252-bee0-c024941e2127 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:57.374189 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-34c22864-0408-4252-bee0-c024941e2127 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1522 microversion: 2.1 time: 0.151906 Aug 24 07:41:57.374764 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 113/234] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:57 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:57.769315 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-f80be828-ac54-43bf-947d-0115ef7cfaf5 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:57.770013 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-f80be828-ac54-43bf-947d-0115ef7cfaf5 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 595e5cfe-e53e-40d4-8841-cbc65440f5f1] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:57.775994 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f80be828-ac54-43bf-947d-0115ef7cfaf5 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:57.776477 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f80be828-ac54-43bf-947d-0115ef7cfaf5 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:57.776910 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f80be828-ac54-43bf-947d-0115ef7cfaf5 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:57.777604 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f80be828-ac54-43bf-947d-0115ef7cfaf5 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:57.778065 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f80be828-ac54-43bf-947d-0115ef7cfaf5 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:57.778488 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f80be828-ac54-43bf-947d-0115ef7cfaf5 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:57.909845 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-f80be828-ac54-43bf-947d-0115ef7cfaf5 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:57.917331 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-f80be828-ac54-43bf-947d-0115ef7cfaf5 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1" status: 200 len: 1313 microversion: 2.1 time: 0.151979 Aug 24 07:41:57.917887 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 122/235] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:57 2022] GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:58.120952 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-2c0e054e-9609-48db-b9b2-712877034999 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:58.121553 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-2c0e054e-9609-48db-b9b2-712877034999 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:58.128081 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2c0e054e-9609-48db-b9b2-712877034999 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:58.128496 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2c0e054e-9609-48db-b9b2-712877034999 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:58.128922 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2c0e054e-9609-48db-b9b2-712877034999 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:58.129599 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2c0e054e-9609-48db-b9b2-712877034999 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:58.130046 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2c0e054e-9609-48db-b9b2-712877034999 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:58.130459 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2c0e054e-9609-48db-b9b2-712877034999 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:58.258758 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-2c0e054e-9609-48db-b9b2-712877034999 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:58.266828 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-2c0e054e-9609-48db-b9b2-712877034999 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 200 len: 1722 microversion: 2.1 time: 0.149679 Aug 24 07:41:58.267465 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 114/236] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:58 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:58.394811 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-fcd67f03-cd29-4378-b4b1-1c5005aa86c0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:58.395412 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-fcd67f03-cd29-4378-b4b1-1c5005aa86c0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:58.402216 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fcd67f03-cd29-4378-b4b1-1c5005aa86c0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:58.402688 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fcd67f03-cd29-4378-b4b1-1c5005aa86c0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:58.403143 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fcd67f03-cd29-4378-b4b1-1c5005aa86c0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:58.403821 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fcd67f03-cd29-4378-b4b1-1c5005aa86c0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:58.404269 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fcd67f03-cd29-4378-b4b1-1c5005aa86c0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:58.404681 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fcd67f03-cd29-4378-b4b1-1c5005aa86c0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:58.541012 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-fcd67f03-cd29-4378-b4b1-1c5005aa86c0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:58.548509 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-fcd67f03-cd29-4378-b4b1-1c5005aa86c0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1522 microversion: 2.1 time: 0.157607 Aug 24 07:41:58.549063 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 123/237] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:58 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:58.939045 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-ca55114b-4aad-426e-8b2d-ec32ce3b1fac tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:58.940329 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-ca55114b-4aad-426e-8b2d-ec32ce3b1fac tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 595e5cfe-e53e-40d4-8841-cbc65440f5f1] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:58.946975 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ca55114b-4aad-426e-8b2d-ec32ce3b1fac tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:58.947737 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ca55114b-4aad-426e-8b2d-ec32ce3b1fac tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:58.948098 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ca55114b-4aad-426e-8b2d-ec32ce3b1fac tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:58.948860 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ca55114b-4aad-426e-8b2d-ec32ce3b1fac tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:58.949399 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ca55114b-4aad-426e-8b2d-ec32ce3b1fac tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:58.950018 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ca55114b-4aad-426e-8b2d-ec32ce3b1fac tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:59.079016 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-ca55114b-4aad-426e-8b2d-ec32ce3b1fac tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:59.087149 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-ca55114b-4aad-426e-8b2d-ec32ce3b1fac tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1" status: 200 len: 1313 microversion: 2.1 time: 0.152136 Aug 24 07:41:59.087715 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 115/238] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:58 2022] GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:59.287264 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-f391ae29-4052-42e5-8fff-4e8284a25727 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:59.287814 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-f391ae29-4052-42e5-8fff-4e8284a25727 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:59.294206 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f391ae29-4052-42e5-8fff-4e8284a25727 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:59.294704 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f391ae29-4052-42e5-8fff-4e8284a25727 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:59.295147 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f391ae29-4052-42e5-8fff-4e8284a25727 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:59.295864 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f391ae29-4052-42e5-8fff-4e8284a25727 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:59.296274 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f391ae29-4052-42e5-8fff-4e8284a25727 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:59.296688 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f391ae29-4052-42e5-8fff-4e8284a25727 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:59.426334 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-f391ae29-4052-42e5-8fff-4e8284a25727 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:59.434867 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-f391ae29-4052-42e5-8fff-4e8284a25727 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 200 len: 1722 microversion: 2.1 time: 0.152102 Aug 24 07:41:59.435417 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 124/239] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:59 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:41:59.569274 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-45bcd935-6ccb-4aa7-89b2-f3526c81d6da tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:41:59.569793 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-45bcd935-6ccb-4aa7-89b2-f3526c81d6da tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:41:59.575749 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-45bcd935-6ccb-4aa7-89b2-f3526c81d6da tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:59.576217 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-45bcd935-6ccb-4aa7-89b2-f3526c81d6da tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:59.576642 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-45bcd935-6ccb-4aa7-89b2-f3526c81d6da tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:59.577316 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-45bcd935-6ccb-4aa7-89b2-f3526c81d6da tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:41:59.577765 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-45bcd935-6ccb-4aa7-89b2-f3526c81d6da tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:41:59.578177 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-45bcd935-6ccb-4aa7-89b2-f3526c81d6da tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:41:59.717425 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-45bcd935-6ccb-4aa7-89b2-f3526c81d6da tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:41:59.725125 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-45bcd935-6ccb-4aa7-89b2-f3526c81d6da tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1522 microversion: 2.1 time: 0.159719 Aug 24 07:41:59.725691 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 116/240] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:41:59 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:00.108283 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-9fe0995e-9ebf-4d6f-8387-df3c6b94e37b tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:00.108883 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-9fe0995e-9ebf-4d6f-8387-df3c6b94e37b tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 595e5cfe-e53e-40d4-8841-cbc65440f5f1] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:00.114959 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9fe0995e-9ebf-4d6f-8387-df3c6b94e37b tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:00.115436 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9fe0995e-9ebf-4d6f-8387-df3c6b94e37b tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:00.115860 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9fe0995e-9ebf-4d6f-8387-df3c6b94e37b tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:00.116535 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9fe0995e-9ebf-4d6f-8387-df3c6b94e37b tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:00.116978 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9fe0995e-9ebf-4d6f-8387-df3c6b94e37b tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:00.117398 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9fe0995e-9ebf-4d6f-8387-df3c6b94e37b tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:00.250283 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-9fe0995e-9ebf-4d6f-8387-df3c6b94e37b tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:00.257839 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-9fe0995e-9ebf-4d6f-8387-df3c6b94e37b tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1" status: 200 len: 1313 microversion: 2.1 time: 0.153479 Aug 24 07:42:00.258420 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 125/241] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:00 2022] GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:00.455889 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-19b30830-cdd8-41e1-86cf-73ce8d6ea9bf tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:00.456406 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-19b30830-cdd8-41e1-86cf-73ce8d6ea9bf tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:00.462780 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-19b30830-cdd8-41e1-86cf-73ce8d6ea9bf tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:00.463266 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-19b30830-cdd8-41e1-86cf-73ce8d6ea9bf tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:00.463742 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-19b30830-cdd8-41e1-86cf-73ce8d6ea9bf tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:00.464426 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-19b30830-cdd8-41e1-86cf-73ce8d6ea9bf tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:00.464876 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-19b30830-cdd8-41e1-86cf-73ce8d6ea9bf tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:00.465296 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-19b30830-cdd8-41e1-86cf-73ce8d6ea9bf tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:00.595916 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-19b30830-cdd8-41e1-86cf-73ce8d6ea9bf tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:00.603952 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-19b30830-cdd8-41e1-86cf-73ce8d6ea9bf tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 200 len: 1722 microversion: 2.1 time: 0.152549 Aug 24 07:42:00.604513 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 117/242] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:00 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:00.745445 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-e1eb4725-fba7-4f4d-b65e-dcd60975516f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:00.745988 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-e1eb4725-fba7-4f4d-b65e-dcd60975516f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:00.752573 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e1eb4725-fba7-4f4d-b65e-dcd60975516f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:00.753053 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e1eb4725-fba7-4f4d-b65e-dcd60975516f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:00.753495 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e1eb4725-fba7-4f4d-b65e-dcd60975516f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:00.754311 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e1eb4725-fba7-4f4d-b65e-dcd60975516f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:00.754806 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e1eb4725-fba7-4f4d-b65e-dcd60975516f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:00.755233 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e1eb4725-fba7-4f4d-b65e-dcd60975516f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:00.801154 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [req-082667b1-8f74-4d3a-aff0-3e9772a45a63 req-b92917aa-a940-4d03-bb54-978ec954cfcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "595e5cfe-e53e-40d4-8841-cbc65440f5f1", "name": "network-vif-plugged", "status": "completed", "tag": "96c9a585-ee04-446f-8199-ee2f9ea2848e"}]} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:42:00.852461 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-082667b1-8f74-4d3a-aff0-3e9772a45a63 req-b92917aa-a940-4d03-bb54-978ec954cfcc service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:00.853018 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-082667b1-8f74-4d3a-aff0-3e9772a45a63 req-b92917aa-a940-4d03-bb54-978ec954cfcc service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:00.853580 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-082667b1-8f74-4d3a-aff0-3e9772a45a63 req-b92917aa-a940-4d03-bb54-978ec954cfcc service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:00.867478 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.compute.server_external_events [req-082667b1-8f74-4d3a-aff0-3e9772a45a63 req-b92917aa-a940-4d03-bb54-978ec954cfcc service nova] Creating event network-vif-plugged:96c9a585-ee04-446f-8199-ee2f9ea2848e for instance 595e5cfe-e53e-40d4-8841-cbc65440f5f1 on hv-cinder-85427 Aug 24 07:42:00.872788 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [req-082667b1-8f74-4d3a-aff0-3e9772a45a63 req-b92917aa-a940-4d03-bb54-978ec954cfcc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076187 Aug 24 07:42:00.873781 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 118/243] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:42:00.904859 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-e1eb4725-fba7-4f4d-b65e-dcd60975516f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:00.914033 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-e1eb4725-fba7-4f4d-b65e-dcd60975516f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1522 microversion: 2.1 time: 0.172397 Aug 24 07:42:00.914606 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 126/244] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:00 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:01.279183 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-b2b6865d-b940-47ba-a1c0-fd97dcd1b3f5 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:01.279863 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-b2b6865d-b940-47ba-a1c0-fd97dcd1b3f5 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 595e5cfe-e53e-40d4-8841-cbc65440f5f1] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:01.286356 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b2b6865d-b940-47ba-a1c0-fd97dcd1b3f5 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:01.286856 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b2b6865d-b940-47ba-a1c0-fd97dcd1b3f5 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:01.287280 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b2b6865d-b940-47ba-a1c0-fd97dcd1b3f5 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:01.287952 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b2b6865d-b940-47ba-a1c0-fd97dcd1b3f5 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:01.288394 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b2b6865d-b940-47ba-a1c0-fd97dcd1b3f5 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:01.288806 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b2b6865d-b940-47ba-a1c0-fd97dcd1b3f5 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:01.417704 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-b2b6865d-b940-47ba-a1c0-fd97dcd1b3f5 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:01.425961 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-b2b6865d-b940-47ba-a1c0-fd97dcd1b3f5 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1" status: 200 len: 1313 microversion: 2.1 time: 0.150936 Aug 24 07:42:01.426522 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 119/245] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:01 2022] GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:01.625478 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-8a7ba785-d6c8-417a-99e6-9b77aa9692df tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:01.626081 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-8a7ba785-d6c8-417a-99e6-9b77aa9692df tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:01.632117 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8a7ba785-d6c8-417a-99e6-9b77aa9692df tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:01.632597 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8a7ba785-d6c8-417a-99e6-9b77aa9692df tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:01.633030 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8a7ba785-d6c8-417a-99e6-9b77aa9692df tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:01.633711 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8a7ba785-d6c8-417a-99e6-9b77aa9692df tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:01.634163 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8a7ba785-d6c8-417a-99e6-9b77aa9692df tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:01.634584 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8a7ba785-d6c8-417a-99e6-9b77aa9692df tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:01.764476 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-8a7ba785-d6c8-417a-99e6-9b77aa9692df tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:01.773252 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-8a7ba785-d6c8-417a-99e6-9b77aa9692df tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 200 len: 1722 microversion: 2.1 time: 0.151637 Aug 24 07:42:01.773813 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 127/246] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:01 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:01.935881 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-ac33f481-73e4-4981-9200-9054e1ca8041 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:01.936486 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-ac33f481-73e4-4981-9200-9054e1ca8041 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:01.938428 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:42:01.944448 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ac33f481-73e4-4981-9200-9054e1ca8041 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:01.944929 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ac33f481-73e4-4981-9200-9054e1ca8041 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:01.945365 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ac33f481-73e4-4981-9200-9054e1ca8041 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:01.946054 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ac33f481-73e4-4981-9200-9054e1ca8041 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:01.946503 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ac33f481-73e4-4981-9200-9054e1ca8041 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:01.946945 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ac33f481-73e4-4981-9200-9054e1ca8041 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:02.077490 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-ac33f481-73e4-4981-9200-9054e1ca8041 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:02.092927 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-ac33f481-73e4-4981-9200-9054e1ca8041 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1522 microversion: 2.1 time: 0.160805 Aug 24 07:42:02.093501 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 120/247] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:01 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:02.446499 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-7fb8640e-474a-44b4-83cb-1f1a20570e80 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:02.447152 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-7fb8640e-474a-44b4-83cb-1f1a20570e80 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 595e5cfe-e53e-40d4-8841-cbc65440f5f1] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:02.453076 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7fb8640e-474a-44b4-83cb-1f1a20570e80 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:02.453545 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7fb8640e-474a-44b4-83cb-1f1a20570e80 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:02.453971 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7fb8640e-474a-44b4-83cb-1f1a20570e80 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:02.454642 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7fb8640e-474a-44b4-83cb-1f1a20570e80 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:02.455111 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7fb8640e-474a-44b4-83cb-1f1a20570e80 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:02.455526 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7fb8640e-474a-44b4-83cb-1f1a20570e80 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:02.582715 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-7fb8640e-474a-44b4-83cb-1f1a20570e80 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:02.590755 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-7fb8640e-474a-44b4-83cb-1f1a20570e80 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1" status: 200 len: 1313 microversion: 2.1 time: 0.148028 Aug 24 07:42:02.591315 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 128/248] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:02 2022] GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:02.793374 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-072720f9-03f7-4431-bba6-421db886ff8a tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:02.793901 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-072720f9-03f7-4431-bba6-421db886ff8a tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:02.799723 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-072720f9-03f7-4431-bba6-421db886ff8a tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:02.800282 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-072720f9-03f7-4431-bba6-421db886ff8a tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:02.800704 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-072720f9-03f7-4431-bba6-421db886ff8a tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:02.801369 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-072720f9-03f7-4431-bba6-421db886ff8a tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:02.801810 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-072720f9-03f7-4431-bba6-421db886ff8a tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:02.802222 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-072720f9-03f7-4431-bba6-421db886ff8a tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:02.942160 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-072720f9-03f7-4431-bba6-421db886ff8a tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:02.951138 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-072720f9-03f7-4431-bba6-421db886ff8a tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 200 len: 1722 microversion: 2.1 time: 0.161612 Aug 24 07:42:02.954743 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 121/249] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:02 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:03.113113 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-2eb3700f-749c-4d97-b08f-4b2b654544c6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:03.113818 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-2eb3700f-749c-4d97-b08f-4b2b654544c6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:03.121407 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2eb3700f-749c-4d97-b08f-4b2b654544c6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:03.121957 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2eb3700f-749c-4d97-b08f-4b2b654544c6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:03.122475 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2eb3700f-749c-4d97-b08f-4b2b654544c6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:03.123189 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2eb3700f-749c-4d97-b08f-4b2b654544c6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:03.123643 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2eb3700f-749c-4d97-b08f-4b2b654544c6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:03.124056 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2eb3700f-749c-4d97-b08f-4b2b654544c6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:03.254561 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-2eb3700f-749c-4d97-b08f-4b2b654544c6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:03.264626 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-2eb3700f-749c-4d97-b08f-4b2b654544c6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1522 microversion: 2.1 time: 0.154967 Aug 24 07:42:03.265397 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 129/250] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:03 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:03.612428 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-1f1b9584-f824-48d5-b1d7-8df18cc17c19 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:03.613035 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-1f1b9584-f824-48d5-b1d7-8df18cc17c19 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 595e5cfe-e53e-40d4-8841-cbc65440f5f1] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:03.618959 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1f1b9584-f824-48d5-b1d7-8df18cc17c19 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:03.619428 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1f1b9584-f824-48d5-b1d7-8df18cc17c19 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:03.619852 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1f1b9584-f824-48d5-b1d7-8df18cc17c19 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:03.620549 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1f1b9584-f824-48d5-b1d7-8df18cc17c19 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:03.620992 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1f1b9584-f824-48d5-b1d7-8df18cc17c19 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:03.621401 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1f1b9584-f824-48d5-b1d7-8df18cc17c19 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:03.756487 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-1f1b9584-f824-48d5-b1d7-8df18cc17c19 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:03.763995 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-1f1b9584-f824-48d5-b1d7-8df18cc17c19 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1" status: 200 len: 1497 microversion: 2.1 time: 0.155890 Aug 24 07:42:03.764550 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 122/251] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:03 2022] GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1 => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:03.973215 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-d4ab85c9-703e-4266-a49d-9afeafeb6ff4 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:03.973742 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-d4ab85c9-703e-4266-a49d-9afeafeb6ff4 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:03.980022 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d4ab85c9-703e-4266-a49d-9afeafeb6ff4 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:03.980553 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d4ab85c9-703e-4266-a49d-9afeafeb6ff4 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:03.980997 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d4ab85c9-703e-4266-a49d-9afeafeb6ff4 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:03.981865 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d4ab85c9-703e-4266-a49d-9afeafeb6ff4 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:03.982548 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d4ab85c9-703e-4266-a49d-9afeafeb6ff4 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:03.983022 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d4ab85c9-703e-4266-a49d-9afeafeb6ff4 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:03.987728 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:42:04.133624 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-d4ab85c9-703e-4266-a49d-9afeafeb6ff4 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:04.141922 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-d4ab85c9-703e-4266-a49d-9afeafeb6ff4 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 200 len: 1722 microversion: 2.1 time: 0.172682 Aug 24 07:42:04.142479 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 130/252] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:03 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:04.288369 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-286e1b42-9a9a-45f2-9691-fa758d81b3a0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:04.288962 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-286e1b42-9a9a-45f2-9691-fa758d81b3a0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:04.294821 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-286e1b42-9a9a-45f2-9691-fa758d81b3a0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:04.295287 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-286e1b42-9a9a-45f2-9691-fa758d81b3a0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:04.295709 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-286e1b42-9a9a-45f2-9691-fa758d81b3a0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:04.296382 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-286e1b42-9a9a-45f2-9691-fa758d81b3a0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:04.296824 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-286e1b42-9a9a-45f2-9691-fa758d81b3a0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:04.297234 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-286e1b42-9a9a-45f2-9691-fa758d81b3a0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:04.301260 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-ff3e3297-199e-48cb-ae64-9bbcc238cad1 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:04.301759 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-ff3e3297-199e-48cb-ae64-9bbcc238cad1 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 595e5cfe-e53e-40d4-8841-cbc65440f5f1] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:04.307870 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ff3e3297-199e-48cb-ae64-9bbcc238cad1 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:04.308346 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ff3e3297-199e-48cb-ae64-9bbcc238cad1 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:04.308773 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ff3e3297-199e-48cb-ae64-9bbcc238cad1 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:04.309454 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ff3e3297-199e-48cb-ae64-9bbcc238cad1 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:04.309903 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ff3e3297-199e-48cb-ae64-9bbcc238cad1 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:04.310320 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ff3e3297-199e-48cb-ae64-9bbcc238cad1 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:04.335972 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-ff3e3297-199e-48cb-ae64-9bbcc238cad1 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 595e5cfe-e53e-40d4-8841-cbc65440f5f1] Going to try to terminate instance {{(pid=127114) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 07:42:04.427387 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-ff3e3297-199e-48cb-ae64-9bbcc238cad1 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "DELETE /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1" status: 204 len: 0 microversion: 2.1 time: 0.129878 Aug 24 07:42:04.427970 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 131/253] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 24 07:42:04 2022] DELETE /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 07:42:04.431497 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-286e1b42-9a9a-45f2-9691-fa758d81b3a0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:04.437496 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-e5565760-7c2e-457f-879a-df65f4363523 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:04.438240 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-e5565760-7c2e-457f-879a-df65f4363523 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 595e5cfe-e53e-40d4-8841-cbc65440f5f1] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:04.438377 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-286e1b42-9a9a-45f2-9691-fa758d81b3a0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1522 microversion: 2.1 time: 0.153788 Aug 24 07:42:04.438970 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 123/254] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:04 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:04.444337 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e5565760-7c2e-457f-879a-df65f4363523 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:04.444823 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e5565760-7c2e-457f-879a-df65f4363523 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:04.445257 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e5565760-7c2e-457f-879a-df65f4363523 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:04.445948 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e5565760-7c2e-457f-879a-df65f4363523 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:04.446405 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e5565760-7c2e-457f-879a-df65f4363523 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:04.446858 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e5565760-7c2e-457f-879a-df65f4363523 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:04.574999 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-e5565760-7c2e-457f-879a-df65f4363523 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:04.582675 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-e5565760-7c2e-457f-879a-df65f4363523 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1" status: 200 len: 1503 microversion: 2.1 time: 0.150026 Aug 24 07:42:04.583273 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 132/255] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:04 2022] GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1 => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:05.162917 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-e8b18493-1ed4-4525-9550-2a25d17c1ff1 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:05.163518 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-e8b18493-1ed4-4525-9550-2a25d17c1ff1 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:05.169279 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e8b18493-1ed4-4525-9550-2a25d17c1ff1 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:05.169769 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e8b18493-1ed4-4525-9550-2a25d17c1ff1 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:05.170193 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e8b18493-1ed4-4525-9550-2a25d17c1ff1 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:05.170900 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e8b18493-1ed4-4525-9550-2a25d17c1ff1 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:05.171346 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e8b18493-1ed4-4525-9550-2a25d17c1ff1 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:05.171756 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e8b18493-1ed4-4525-9550-2a25d17c1ff1 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:05.307030 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-e8b18493-1ed4-4525-9550-2a25d17c1ff1 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:05.315729 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-e8b18493-1ed4-4525-9550-2a25d17c1ff1 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 200 len: 1722 microversion: 2.1 time: 0.156515 Aug 24 07:42:05.316374 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 124/256] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:05 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:05.459205 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-a07e3fec-d7cc-4369-9fb7-1cf72d0af678 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:05.459713 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-a07e3fec-d7cc-4369-9fb7-1cf72d0af678 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:05.466153 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a07e3fec-d7cc-4369-9fb7-1cf72d0af678 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:05.466630 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a07e3fec-d7cc-4369-9fb7-1cf72d0af678 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:05.467103 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a07e3fec-d7cc-4369-9fb7-1cf72d0af678 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:05.467785 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a07e3fec-d7cc-4369-9fb7-1cf72d0af678 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:05.468242 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a07e3fec-d7cc-4369-9fb7-1cf72d0af678 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:05.468658 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a07e3fec-d7cc-4369-9fb7-1cf72d0af678 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:05.601692 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-a07e3fec-d7cc-4369-9fb7-1cf72d0af678 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:05.602921 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-90b9907a-f407-4a45-83bd-4c16f709e535 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:05.603526 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-90b9907a-f407-4a45-83bd-4c16f709e535 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 595e5cfe-e53e-40d4-8841-cbc65440f5f1] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:05.609466 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-90b9907a-f407-4a45-83bd-4c16f709e535 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:05.609782 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-a07e3fec-d7cc-4369-9fb7-1cf72d0af678 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1522 microversion: 2.1 time: 0.154516 Aug 24 07:42:05.609935 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-90b9907a-f407-4a45-83bd-4c16f709e535 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:05.610355 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 133/257] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:05 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:05.610461 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-90b9907a-f407-4a45-83bd-4c16f709e535 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:05.611066 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-90b9907a-f407-4a45-83bd-4c16f709e535 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:05.611693 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-90b9907a-f407-4a45-83bd-4c16f709e535 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:05.612265 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-90b9907a-f407-4a45-83bd-4c16f709e535 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:05.747863 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-90b9907a-f407-4a45-83bd-4c16f709e535 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:05.755509 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-90b9907a-f407-4a45-83bd-4c16f709e535 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1" status: 200 len: 1503 microversion: 2.1 time: 0.156353 Aug 24 07:42:05.756059 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 125/258] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:05 2022] GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:42:06.341363 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-ff082590-1a81-41e1-8e66-3a353e55567b tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:06.341884 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-ff082590-1a81-41e1-8e66-3a353e55567b tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:06.348013 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ff082590-1a81-41e1-8e66-3a353e55567b tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:06.348501 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ff082590-1a81-41e1-8e66-3a353e55567b tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:06.348943 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ff082590-1a81-41e1-8e66-3a353e55567b tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:06.349626 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ff082590-1a81-41e1-8e66-3a353e55567b tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:06.350080 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ff082590-1a81-41e1-8e66-3a353e55567b tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:06.350499 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ff082590-1a81-41e1-8e66-3a353e55567b tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:06.584480 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-ff082590-1a81-41e1-8e66-3a353e55567b tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:06.590290 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-ff082590-1a81-41e1-8e66-3a353e55567b tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 200 len: 1722 microversion: 2.1 time: 0.252783 Aug 24 07:42:06.591104 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 134/259] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:06 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 1722 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:06.631016 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-9d0c5c61-1a2f-4373-86de-8f52f81aa23d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:06.631625 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-9d0c5c61-1a2f-4373-86de-8f52f81aa23d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:06.637954 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9d0c5c61-1a2f-4373-86de-8f52f81aa23d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:06.638516 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9d0c5c61-1a2f-4373-86de-8f52f81aa23d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:06.639058 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9d0c5c61-1a2f-4373-86de-8f52f81aa23d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:06.639965 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9d0c5c61-1a2f-4373-86de-8f52f81aa23d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:06.640421 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9d0c5c61-1a2f-4373-86de-8f52f81aa23d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:06.640839 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9d0c5c61-1a2f-4373-86de-8f52f81aa23d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:06.776544 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-54f73417-96e8-43c1-8aea-93dd406812f7 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:06.777157 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-54f73417-96e8-43c1-8aea-93dd406812f7 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 595e5cfe-e53e-40d4-8841-cbc65440f5f1] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:06.783727 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-54f73417-96e8-43c1-8aea-93dd406812f7 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:06.784210 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-54f73417-96e8-43c1-8aea-93dd406812f7 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:06.784817 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-54f73417-96e8-43c1-8aea-93dd406812f7 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:06.785517 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-54f73417-96e8-43c1-8aea-93dd406812f7 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:06.785970 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-54f73417-96e8-43c1-8aea-93dd406812f7 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:06.786666 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-54f73417-96e8-43c1-8aea-93dd406812f7 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:07.023232 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-9d0c5c61-1a2f-4373-86de-8f52f81aa23d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:07.031331 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-9d0c5c61-1a2f-4373-86de-8f52f81aa23d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1522 microversion: 2.1 time: 0.404694 Aug 24 07:42:07.031896 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 126/260] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:06 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1522 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:07.036965 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [req-b58d1820-2abc-4e4a-b4a6-b1a3a74ed233 req-74e183c1-2dfc-444f-9a90-65e658eeb4e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "595e5cfe-e53e-40d4-8841-cbc65440f5f1", "name": "network-vif-deleted", "tag": "96c9a585-ee04-446f-8199-ee2f9ea2848e"}]} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:42:07.046077 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-b58d1820-2abc-4e4a-b4a6-b1a3a74ed233 req-74e183c1-2dfc-444f-9a90-65e658eeb4e3 service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:07.046546 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-b58d1820-2abc-4e4a-b4a6-b1a3a74ed233 req-74e183c1-2dfc-444f-9a90-65e658eeb4e3 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:07.046993 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-b58d1820-2abc-4e4a-b4a6-b1a3a74ed233 req-74e183c1-2dfc-444f-9a90-65e658eeb4e3 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:07.051030 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell1:SELECT=100 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:42:07.059378 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.compute.server_external_events [req-b58d1820-2abc-4e4a-b4a6-b1a3a74ed233 req-74e183c1-2dfc-444f-9a90-65e658eeb4e3 service nova] Creating event network-vif-deleted:96c9a585-ee04-446f-8199-ee2f9ea2848e for instance 595e5cfe-e53e-40d4-8841-cbc65440f5f1 on hv-cinder-85427 Aug 24 07:42:07.065525 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [req-b58d1820-2abc-4e4a-b4a6-b1a3a74ed233 req-74e183c1-2dfc-444f-9a90-65e658eeb4e3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032125 Aug 24 07:42:07.066629 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 127/261] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:42:07.073639 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-54f73417-96e8-43c1-8aea-93dd406812f7 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:07.083062 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-54f73417-96e8-43c1-8aea-93dd406812f7 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1" status: 200 len: 1461 microversion: 2.1 time: 0.310094 Aug 24 07:42:07.084202 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 135/262] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:06 2022] GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1 => generated 1461 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:42:07.612775 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-081d7e4a-2fb5-4c1e-bad6-96d1165caec5 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:07.613496 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-081d7e4a-2fb5-4c1e-bad6-96d1165caec5 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:07.619823 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-081d7e4a-2fb5-4c1e-bad6-96d1165caec5 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:07.620301 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-081d7e4a-2fb5-4c1e-bad6-96d1165caec5 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:07.620735 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-081d7e4a-2fb5-4c1e-bad6-96d1165caec5 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:07.621414 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-081d7e4a-2fb5-4c1e-bad6-96d1165caec5 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:07.621866 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-081d7e4a-2fb5-4c1e-bad6-96d1165caec5 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:07.622292 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-081d7e4a-2fb5-4c1e-bad6-96d1165caec5 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:07.749172 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-081d7e4a-2fb5-4c1e-bad6-96d1165caec5 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:07.757992 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-081d7e4a-2fb5-4c1e-bad6-96d1165caec5 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 200 len: 1722 microversion: 2.1 time: 0.149839 Aug 24 07:42:07.758550 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 128/263] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:07 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:08.053799 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-b75ab414-7c45-4c52-b099-7bbec274a290 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:08.054544 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-b75ab414-7c45-4c52-b099-7bbec274a290 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:08.062055 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b75ab414-7c45-4c52-b099-7bbec274a290 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:08.062629 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b75ab414-7c45-4c52-b099-7bbec274a290 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:08.063157 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b75ab414-7c45-4c52-b099-7bbec274a290 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:08.064006 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b75ab414-7c45-4c52-b099-7bbec274a290 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:08.065141 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b75ab414-7c45-4c52-b099-7bbec274a290 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:08.065590 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b75ab414-7c45-4c52-b099-7bbec274a290 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:08.104506 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-5f1b53c7-ae6a-4c16-ad10-1138c0c5c129 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:08.105108 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-5f1b53c7-ae6a-4c16-ad10-1138c0c5c129 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 595e5cfe-e53e-40d4-8841-cbc65440f5f1] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:08.111622 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5f1b53c7-ae6a-4c16-ad10-1138c0c5c129 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:08.112098 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5f1b53c7-ae6a-4c16-ad10-1138c0c5c129 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:08.112524 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5f1b53c7-ae6a-4c16-ad10-1138c0c5c129 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:08.113290 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5f1b53c7-ae6a-4c16-ad10-1138c0c5c129 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:08.113734 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5f1b53c7-ae6a-4c16-ad10-1138c0c5c129 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:08.114145 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5f1b53c7-ae6a-4c16-ad10-1138c0c5c129 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:08.127902 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.wsgi [None req-5f1b53c7-ae6a-4c16-ad10-1138c0c5c129 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] HTTP exception thrown: Instance 595e5cfe-e53e-40d4-8841-cbc65440f5f1 could not be found. Aug 24 07:42:08.129609 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-5f1b53c7-ae6a-4c16-ad10-1138c0c5c129 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Request method failure captured: Aug 24 07:42:08.129609 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: request: GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1 HTTP/1.1 Aug 24 07:42:08.129609 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept: application/json Aug 24 07:42:08.129609 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept-Encoding: identity Aug 24 07:42:08.129609 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Connection: close Aug 24 07:42:08.129609 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Length: 0 Aug 24 07:42:08.129609 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Type: application/json Aug 24 07:42:08.129609 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Host: 10.222.0.42 Aug 24 07:42:08.129609 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Openstack-System-Scope: None Aug 24 07:42:08.129609 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: User-Agent: python-urllib3/1.26.11 Aug 24 07:42:08.129609 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Auth-Token: gAAAAABjBdYtfg37b_yRauNCMNCISCe0CYmpmYHpxzBTBwVj_tLHcB9Bc2EtvkBGNSDrt_0IpkQc57c0rFGAUf2TQNIlVj9L8UQT8cTQepJVWPxjR04Jy3BIkBI4MDMnqXaJTkhbQqi2dSfM0X6Akr6XjIrRL2_I_6ssAqn-pNym1UO54AHNoU8 Aug 24 07:42:08.129609 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Id: None Aug 24 07:42:08.129609 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Name: None Aug 24 07:42:08.129609 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Identity-Status: Confirmed Aug 24 07:42:08.129609 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Is-Admin-Project: True Aug 24 07:42:08.129609 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Id: default Aug 24 07:42:08.129609 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Name: Default Aug 24 07:42:08.129609 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Id: 71f10902cae64a09b587e9a481ce9e41 Aug 24 07:42:08.129609 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Name: tempest-VolumesActionsTest-981695490 Aug 24 07:42:08.129609 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Role: reader,member Aug 24 07:42:08.129609 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Roles: reader,member Aug 24 07:42:08.130894 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/71f10902cae64a09b587e9a481ce9e41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_71f10902cae64a09b587e9a481ce9e41", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/71f10902cae64a09b587e9a481ce9e41"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/71f10902cae64a09b587e9a481ce9e41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:42:08.130894 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant: tempest-VolumesActionsTest-981695490 Aug 24 07:42:08.130894 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Id: 71f10902cae64a09b587e9a481ce9e41 Aug 24 07:42:08.130894 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Name: tempest-VolumesActionsTest-981695490 Aug 24 07:42:08.130894 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User: tempest-VolumesActionsTest-981695490-project Aug 24 07:42:08.130894 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Id: default Aug 24 07:42:08.130894 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Name: Default Aug 24 07:42:08.130894 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Id: c7f3a776c48e4cebb7624d215f93cd1a Aug 24 07:42:08.130894 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Name: tempest-VolumesActionsTest-981695490-project Aug 24 07:42:08.130894 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: method: > Aug 24 07:42:08.130894 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: exception: Instance 595e5cfe-e53e-40d4-8841-cbc65440f5f1 could not be found. Aug 24 07:42:08.130894 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: action_args: {'id': '595e5cfe-e53e-40d4-8841-cbc65440f5f1'} Aug 24 07:42:08.131595 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:42:08.131595 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:42:08.131595 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:42:08.131595 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:42:08.131595 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:42:08.131595 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:42:08.131595 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:42:08.131595 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:42:08.131595 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:42:08.131595 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:42:08.131595 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 595e5cfe-e53e-40d4-8841-cbc65440f5f1 could not be found. Aug 24 07:42:08.131595 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:42:08.131595 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:42:08.131595 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:42:08.131595 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:42:08.131595 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:42:08.131595 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:42:08.131595 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:42:08.131595 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:42:08.131595 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:42:08.133372 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:42:08.133372 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 07:42:08.133372 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 07:42:08.133372 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:42:08.133372 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:42:08.133372 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:42:08.133372 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:42:08.133372 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 595e5cfe-e53e-40d4-8841-cbc65440f5f1 could not be found. Aug 24 07:42:08.133372 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:42:08.133372 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:42:08.133372 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:42:08.133372 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:42:08.133372 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:42:08.133372 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:42:08.133372 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:42:08.133372 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:42:08.133372 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 595e5cfe-e53e-40d4-8841-cbc65440f5f1 could not be found. Aug 24 07:42:08.133372 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:42:08.134357 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-5f1b53c7-ae6a-4c16-ad10-1138c0c5c129 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Returning 404 to user: Instance 595e5cfe-e53e-40d4-8841-cbc65440f5f1 could not be found. {{(pid=127113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:42:08.134357 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-5f1b53c7-ae6a-4c16-ad10-1138c0c5c129 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1" status: 404 len: 111 microversion: 2.1 time: 0.030299 Aug 24 07:42:08.134357 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 129/264] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:08 2022] GET /compute/v2.1/servers/595e5cfe-e53e-40d4-8841-cbc65440f5f1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 07:42:08.196052 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-b75ab414-7c45-4c52-b099-7bbec274a290 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:08.204228 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-b75ab414-7c45-4c52-b099-7bbec274a290 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1522 microversion: 2.1 time: 0.155518 Aug 24 07:42:08.205442 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 136/265] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:08 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:08.363140 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-ad3bf32d-ae5e-4e4a-b513-b892d89926e9 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1691360108", "imageRef": "4358f547-a499-43f3-9c84-925d78cd73db", "flavorRef": "452", "networks": [{"uuid": "34f9c04a-0edf-4f6a-9a75-8ec574dd0214"}]}} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:42:08.778968 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-a600d5fb-1415-48cc-8d86-72f4aa5c77de tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:08.779571 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-a600d5fb-1415-48cc-8d86-72f4aa5c77de tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:08.786336 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a600d5fb-1415-48cc-8d86-72f4aa5c77de tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:08.786851 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a600d5fb-1415-48cc-8d86-72f4aa5c77de tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:08.787284 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a600d5fb-1415-48cc-8d86-72f4aa5c77de tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:08.788021 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a600d5fb-1415-48cc-8d86-72f4aa5c77de tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:08.788461 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a600d5fb-1415-48cc-8d86-72f4aa5c77de tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:08.789074 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a600d5fb-1415-48cc-8d86-72f4aa5c77de tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:08.924741 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-a600d5fb-1415-48cc-8d86-72f4aa5c77de tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:08.933295 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-a600d5fb-1415-48cc-8d86-72f4aa5c77de tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 200 len: 1699 microversion: 2.1 time: 0.158161 Aug 24 07:42:08.933821 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 137/266] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:08 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 1699 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:08.954363 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-84dfd25d-d7cd-484c-a821-b51810167d1c tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:42:08.960949 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-84dfd25d-d7cd-484c-a821-b51810167d1c tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:08.961429 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-84dfd25d-d7cd-484c-a821-b51810167d1c tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:08.961865 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-84dfd25d-d7cd-484c-a821-b51810167d1c tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:08.983120 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-84dfd25d-d7cd-484c-a821-b51810167d1c tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Going to try to start instance {{(pid=127114) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 07:42:09.023041 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-84dfd25d-d7cd-484c-a821-b51810167d1c tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "POST /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c/action" status: 202 len: 0 microversion: 2.1 time: 0.072263 Aug 24 07:42:09.023664 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 138/267] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 24 07:42:08 2022] POST /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 07:42:09.032065 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-d9352ac3-14e2-4bc3-b788-f42a4aebd18e tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:09.032767 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-d9352ac3-14e2-4bc3-b788-f42a4aebd18e tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:09.038943 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d9352ac3-14e2-4bc3-b788-f42a4aebd18e tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:09.039442 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d9352ac3-14e2-4bc3-b788-f42a4aebd18e tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:09.039887 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d9352ac3-14e2-4bc3-b788-f42a4aebd18e tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:09.040932 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d9352ac3-14e2-4bc3-b788-f42a4aebd18e tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:09.041573 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d9352ac3-14e2-4bc3-b788-f42a4aebd18e tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:09.042099 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d9352ac3-14e2-4bc3-b788-f42a4aebd18e tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:09.220521 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-d9352ac3-14e2-4bc3-b788-f42a4aebd18e tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:09.228693 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-d9352ac3-14e2-4bc3-b788-f42a4aebd18e tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 200 len: 1708 microversion: 2.1 time: 0.200694 Aug 24 07:42:09.229475 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 139/268] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:09 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 1708 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:42:09.233654 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-4977db27-6dc4-4b92-970a-60f33282c4f6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:09.234251 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-4977db27-6dc4-4b92-970a-60f33282c4f6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:09.242030 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4977db27-6dc4-4b92-970a-60f33282c4f6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:09.242520 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4977db27-6dc4-4b92-970a-60f33282c4f6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:09.243032 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4977db27-6dc4-4b92-970a-60f33282c4f6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:09.243673 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4977db27-6dc4-4b92-970a-60f33282c4f6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:09.244156 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4977db27-6dc4-4b92-970a-60f33282c4f6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:09.245200 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4977db27-6dc4-4b92-970a-60f33282c4f6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:09.461569 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-4977db27-6dc4-4b92-970a-60f33282c4f6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:09.470450 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-4977db27-6dc4-4b92-970a-60f33282c4f6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1522 microversion: 2.1 time: 0.240231 Aug 24 07:42:09.471057 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 140/269] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:09 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:10.250752 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-cd4a7739-71a8-4c91-9a90-bef919f781ed tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:10.251397 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-cd4a7739-71a8-4c91-9a90-bef919f781ed tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:10.257749 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cd4a7739-71a8-4c91-9a90-bef919f781ed tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:10.258206 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cd4a7739-71a8-4c91-9a90-bef919f781ed tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:10.258631 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cd4a7739-71a8-4c91-9a90-bef919f781ed tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:10.259330 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cd4a7739-71a8-4c91-9a90-bef919f781ed tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:10.259777 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cd4a7739-71a8-4c91-9a90-bef919f781ed tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:10.260194 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cd4a7739-71a8-4c91-9a90-bef919f781ed tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:10.392009 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-cd4a7739-71a8-4c91-9a90-bef919f781ed tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:10.400837 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-cd4a7739-71a8-4c91-9a90-bef919f781ed tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 200 len: 1708 microversion: 2.1 time: 0.154015 Aug 24 07:42:10.401403 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 141/270] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:10 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 1708 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:42:10.491297 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-3008fcd1-97fa-4357-bcfe-d74ecfacb218 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:10.491918 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-3008fcd1-97fa-4357-bcfe-d74ecfacb218 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:10.497926 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3008fcd1-97fa-4357-bcfe-d74ecfacb218 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:10.498413 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3008fcd1-97fa-4357-bcfe-d74ecfacb218 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:10.498913 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3008fcd1-97fa-4357-bcfe-d74ecfacb218 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:10.499608 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3008fcd1-97fa-4357-bcfe-d74ecfacb218 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:10.500064 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3008fcd1-97fa-4357-bcfe-d74ecfacb218 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:10.500494 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3008fcd1-97fa-4357-bcfe-d74ecfacb218 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:10.631966 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-3008fcd1-97fa-4357-bcfe-d74ecfacb218 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:10.639596 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-3008fcd1-97fa-4357-bcfe-d74ecfacb218 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1522 microversion: 2.1 time: 0.152191 Aug 24 07:42:10.640159 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 142/271] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:10 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:42:11.184006 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.network.neutron [None req-ad3bf32d-ae5e-4e4a-b513-b892d89926e9 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] validate_networks() for [('34f9c04a-0edf-4f6a-9a75-8ec574dd0214', None, None, None, None, None)] {{(pid=127113) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 07:42:11.421673 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-28896925-8920-4a81-ac04-9bbc9d56154f tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:11.422283 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-28896925-8920-4a81-ac04-9bbc9d56154f tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:11.429352 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-28896925-8920-4a81-ac04-9bbc9d56154f tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:11.429835 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-28896925-8920-4a81-ac04-9bbc9d56154f tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:11.430535 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-28896925-8920-4a81-ac04-9bbc9d56154f tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:11.431250 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-28896925-8920-4a81-ac04-9bbc9d56154f tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:11.431704 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-28896925-8920-4a81-ac04-9bbc9d56154f tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:11.432135 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-28896925-8920-4a81-ac04-9bbc9d56154f tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:11.531818 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.virt.hardware [None req-ad3bf32d-ae5e-4e4a-b513-b892d89926e9 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Flavor limits 0:0:0 {{(pid=127113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 07:42:11.532259 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.virt.hardware [None req-ad3bf32d-ae5e-4e4a-b513-b892d89926e9 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Image limits 0:0:0 {{(pid=127113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 07:42:11.532914 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.virt.hardware [None req-ad3bf32d-ae5e-4e4a-b513-b892d89926e9 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Flavor pref 0:0:0 {{(pid=127113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 07:42:11.533942 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.virt.hardware [None req-ad3bf32d-ae5e-4e4a-b513-b892d89926e9 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Image pref 0:0:0 {{(pid=127113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 07:42:11.534562 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.virt.hardware [None req-ad3bf32d-ae5e-4e4a-b513-b892d89926e9 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 07:42:11.543605 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ad3bf32d-ae5e-4e4a-b513-b892d89926e9 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:11.544079 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ad3bf32d-ae5e-4e4a-b513-b892d89926e9 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:11.544509 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ad3bf32d-ae5e-4e4a-b513-b892d89926e9 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:11.545406 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ad3bf32d-ae5e-4e4a-b513-b892d89926e9 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:11.545859 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ad3bf32d-ae5e-4e4a-b513-b892d89926e9 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:11.546413 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ad3bf32d-ae5e-4e4a-b513-b892d89926e9 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:11.563819 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.quota [None req-ad3bf32d-ae5e-4e4a-b513-b892d89926e9 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Getting quotas for project 71f10902cae64a09b587e9a481ce9e41. Resources: {'cores', 'ram', 'instances'} {{(pid=127113) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:42:11.569353 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.quota [None req-ad3bf32d-ae5e-4e4a-b513-b892d89926e9 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Getting quotas for user c7f3a776c48e4cebb7624d215f93cd1a and project 71f10902cae64a09b587e9a481ce9e41. Resources: {'cores', 'ram', 'instances'} {{(pid=127113) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:42:11.575274 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-28896925-8920-4a81-ac04-9bbc9d56154f tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:11.582051 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-ad3bf32d-ae5e-4e4a-b513-b892d89926e9 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Going to run 1 instances... {{(pid=127113) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 07:42:11.584581 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-ad3bf32d-ae5e-4e4a-b513-b892d89926e9 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 2e049e53-afdd-42e1-ad0c-4805c1579f14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4358f547-a499-43f3-9c84-925d78cd73db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127113) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 07:42:11.584874 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-28896925-8920-4a81-ac04-9bbc9d56154f tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 200 len: 1712 microversion: 2.1 time: 0.167029 Aug 24 07:42:11.585447 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 143/272] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:11 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 1712 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:42:11.631386 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-ad3bf32d-ae5e-4e4a-b513-b892d89926e9 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.272626 Aug 24 07:42:11.632225 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 130/273] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 24 07:42:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 3274 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 07:42:11.643387 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-9e2adb70-f0ee-4405-8df2-741ee5defac1 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:11.644044 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-9e2adb70-f0ee-4405-8df2-741ee5defac1 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 2e049e53-afdd-42e1-ad0c-4805c1579f14] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:11.661168 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-5ceb65b0-a82b-4659-85ff-a8fd20132f39 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:11.661864 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-5ceb65b0-a82b-4659-85ff-a8fd20132f39 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:11.668147 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5ceb65b0-a82b-4659-85ff-a8fd20132f39 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:11.668833 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5ceb65b0-a82b-4659-85ff-a8fd20132f39 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:11.669293 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5ceb65b0-a82b-4659-85ff-a8fd20132f39 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:11.670069 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5ceb65b0-a82b-4659-85ff-a8fd20132f39 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:11.670612 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5ceb65b0-a82b-4659-85ff-a8fd20132f39 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:11.671146 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5ceb65b0-a82b-4659-85ff-a8fd20132f39 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:11.699441 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-9e2adb70-f0ee-4405-8df2-741ee5defac1 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:11.707627 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-9e2adb70-f0ee-4405-8df2-741ee5defac1 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14" status: 200 len: 1214 microversion: 2.1 time: 0.068786 Aug 24 07:42:11.708691 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 144/274] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:11 2022] GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14 => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:11.820539 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-5ceb65b0-a82b-4659-85ff-a8fd20132f39 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:11.828297 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-5ceb65b0-a82b-4659-85ff-a8fd20132f39 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1522 microversion: 2.1 time: 0.171718 Aug 24 07:42:11.828863 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 131/275] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:11 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:42:12.727975 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-f2b2f113-cfa5-42d9-940f-d2656ace7da4 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:12.729252 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-f2b2f113-cfa5-42d9-940f-d2656ace7da4 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 2e049e53-afdd-42e1-ad0c-4805c1579f14] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:12.735848 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f2b2f113-cfa5-42d9-940f-d2656ace7da4 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:12.736334 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f2b2f113-cfa5-42d9-940f-d2656ace7da4 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:12.736764 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f2b2f113-cfa5-42d9-940f-d2656ace7da4 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:12.737457 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f2b2f113-cfa5-42d9-940f-d2656ace7da4 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:12.737909 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f2b2f113-cfa5-42d9-940f-d2656ace7da4 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:12.738327 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f2b2f113-cfa5-42d9-940f-d2656ace7da4 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:12.743289 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:42:12.817404 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-f2b2f113-cfa5-42d9-940f-d2656ace7da4 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:12.826739 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-f2b2f113-cfa5-42d9-940f-d2656ace7da4 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14" status: 200 len: 1274 microversion: 2.1 time: 0.102464 Aug 24 07:42:12.828123 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 145/276] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:12 2022] GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14 => generated 1274 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:12.849909 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-eda45c39-436e-42cb-acb0-a8998950dcf9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:12.850525 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-eda45c39-436e-42cb-acb0-a8998950dcf9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:12.856602 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-eda45c39-436e-42cb-acb0-a8998950dcf9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:12.857178 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-eda45c39-436e-42cb-acb0-a8998950dcf9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:12.857615 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-eda45c39-436e-42cb-acb0-a8998950dcf9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:12.858303 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-eda45c39-436e-42cb-acb0-a8998950dcf9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:12.858782 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-eda45c39-436e-42cb-acb0-a8998950dcf9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:12.859207 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-eda45c39-436e-42cb-acb0-a8998950dcf9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:12.994725 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-eda45c39-436e-42cb-acb0-a8998950dcf9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:13.003369 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-eda45c39-436e-42cb-acb0-a8998950dcf9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1522 microversion: 2.1 time: 0.157464 Aug 24 07:42:13.004051 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 132/277] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:12 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:42:13.848813 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-b3d5e2b8-945b-4688-80d3-faa1b9bd02a2 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:13.849526 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-b3d5e2b8-945b-4688-80d3-faa1b9bd02a2 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 2e049e53-afdd-42e1-ad0c-4805c1579f14] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:13.856363 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b3d5e2b8-945b-4688-80d3-faa1b9bd02a2 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:13.856853 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b3d5e2b8-945b-4688-80d3-faa1b9bd02a2 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:13.857297 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b3d5e2b8-945b-4688-80d3-faa1b9bd02a2 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:13.858018 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b3d5e2b8-945b-4688-80d3-faa1b9bd02a2 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:13.859055 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b3d5e2b8-945b-4688-80d3-faa1b9bd02a2 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:13.859487 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b3d5e2b8-945b-4688-80d3-faa1b9bd02a2 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:14.024129 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-5e1253bc-943e-4385-935b-2350d74ba0eb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:14.024773 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-5e1253bc-943e-4385-935b-2350d74ba0eb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:14.030874 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5e1253bc-943e-4385-935b-2350d74ba0eb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:14.031344 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5e1253bc-943e-4385-935b-2350d74ba0eb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:14.031951 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5e1253bc-943e-4385-935b-2350d74ba0eb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:14.032651 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5e1253bc-943e-4385-935b-2350d74ba0eb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:14.033106 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5e1253bc-943e-4385-935b-2350d74ba0eb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:14.033527 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5e1253bc-943e-4385-935b-2350d74ba0eb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:14.041073 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-b3d5e2b8-945b-4688-80d3-faa1b9bd02a2 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:14.049874 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-b3d5e2b8-945b-4688-80d3-faa1b9bd02a2 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14" status: 200 len: 1314 microversion: 2.1 time: 0.204950 Aug 24 07:42:14.050449 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 146/278] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:13 2022] GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:14.074624 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [req-01d631e9-97e3-46c7-b60c-5e6d69b34adb req-afb1ecba-b25f-49f7-b0df-e58f0c7e3078 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e049e53-afdd-42e1-ad0c-4805c1579f14", "tag": "9dfd157f-ec13-4a0a-ba1c-2ff8ed089c8a"}]} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:42:14.086300 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-01d631e9-97e3-46c7-b60c-5e6d69b34adb req-afb1ecba-b25f-49f7-b0df-e58f0c7e3078 service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:14.087116 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-01d631e9-97e3-46c7-b60c-5e6d69b34adb req-afb1ecba-b25f-49f7-b0df-e58f0c7e3078 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:14.087707 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-01d631e9-97e3-46c7-b60c-5e6d69b34adb req-afb1ecba-b25f-49f7-b0df-e58f0c7e3078 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:14.099782 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.compute.server_external_events [req-01d631e9-97e3-46c7-b60c-5e6d69b34adb req-afb1ecba-b25f-49f7-b0df-e58f0c7e3078 service nova] Creating event network-changed:9dfd157f-ec13-4a0a-ba1c-2ff8ed089c8a for instance 2e049e53-afdd-42e1-ad0c-4805c1579f14 on hv-cinder-85427 Aug 24 07:42:14.104664 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [req-01d631e9-97e3-46c7-b60c-5e6d69b34adb req-afb1ecba-b25f-49f7-b0df-e58f0c7e3078 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042205 Aug 24 07:42:14.105264 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 147/279] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:42:14.189472 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-5e1253bc-943e-4385-935b-2350d74ba0eb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:14.197355 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-5e1253bc-943e-4385-935b-2350d74ba0eb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1522 microversion: 2.1 time: 0.177165 Aug 24 07:42:14.197923 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 133/280] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:14 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:42:15.072575 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-e8294b6c-0a2b-4769-944a-a2027b026c63 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:15.073186 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-e8294b6c-0a2b-4769-944a-a2027b026c63 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 2e049e53-afdd-42e1-ad0c-4805c1579f14] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:15.075127 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:42:15.081223 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e8294b6c-0a2b-4769-944a-a2027b026c63 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:15.081696 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e8294b6c-0a2b-4769-944a-a2027b026c63 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:15.082124 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e8294b6c-0a2b-4769-944a-a2027b026c63 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:15.082898 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e8294b6c-0a2b-4769-944a-a2027b026c63 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:15.083353 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e8294b6c-0a2b-4769-944a-a2027b026c63 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:15.083772 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e8294b6c-0a2b-4769-944a-a2027b026c63 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:15.210972 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-e8294b6c-0a2b-4769-944a-a2027b026c63 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:15.217120 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-1a5e264b-2161-4669-9edd-2a56af242b23 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:15.217724 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-1a5e264b-2161-4669-9edd-2a56af242b23 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:15.219580 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-e8294b6c-0a2b-4769-944a-a2027b026c63 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14" status: 200 len: 1314 microversion: 2.1 time: 0.151701 Aug 24 07:42:15.220132 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 148/281] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:15 2022] GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:15.224257 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1a5e264b-2161-4669-9edd-2a56af242b23 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:15.224734 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1a5e264b-2161-4669-9edd-2a56af242b23 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:15.225163 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1a5e264b-2161-4669-9edd-2a56af242b23 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:15.225852 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1a5e264b-2161-4669-9edd-2a56af242b23 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:15.226299 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1a5e264b-2161-4669-9edd-2a56af242b23 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:15.226746 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1a5e264b-2161-4669-9edd-2a56af242b23 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:15.355356 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-1a5e264b-2161-4669-9edd-2a56af242b23 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:15.363052 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-1a5e264b-2161-4669-9edd-2a56af242b23 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1522 microversion: 2.1 time: 0.149597 Aug 24 07:42:15.363702 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 134/282] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:15 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:42:16.240406 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-9acba04f-de91-4a78-bca4-2a34f32f3206 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:16.240990 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-9acba04f-de91-4a78-bca4-2a34f32f3206 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 2e049e53-afdd-42e1-ad0c-4805c1579f14] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:16.247690 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9acba04f-de91-4a78-bca4-2a34f32f3206 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:16.248134 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9acba04f-de91-4a78-bca4-2a34f32f3206 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:16.248514 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9acba04f-de91-4a78-bca4-2a34f32f3206 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:16.249194 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9acba04f-de91-4a78-bca4-2a34f32f3206 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:16.249645 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9acba04f-de91-4a78-bca4-2a34f32f3206 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:16.250063 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9acba04f-de91-4a78-bca4-2a34f32f3206 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:16.375278 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-9acba04f-de91-4a78-bca4-2a34f32f3206 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:16.383888 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-9acba04f-de91-4a78-bca4-2a34f32f3206 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14" status: 200 len: 1314 microversion: 2.1 time: 0.147844 Aug 24 07:42:16.384236 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-54f58722-b9c9-493f-8513-face2d27d84f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:16.384757 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 149/283] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:16 2022] GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:16.384858 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-54f58722-b9c9-493f-8513-face2d27d84f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:16.390624 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-54f58722-b9c9-493f-8513-face2d27d84f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:16.391129 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-54f58722-b9c9-493f-8513-face2d27d84f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:16.392175 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-54f58722-b9c9-493f-8513-face2d27d84f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:16.392864 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-54f58722-b9c9-493f-8513-face2d27d84f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:16.393313 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-54f58722-b9c9-493f-8513-face2d27d84f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:16.393726 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-54f58722-b9c9-493f-8513-face2d27d84f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:16.520985 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-54f58722-b9c9-493f-8513-face2d27d84f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:16.528485 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-54f58722-b9c9-493f-8513-face2d27d84f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1522 microversion: 2.1 time: 0.148012 Aug 24 07:42:16.529074 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 135/284] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:16 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:42:16.848816 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-0882cd96-7f43-46c2-9002-6f664d734696 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b085ad56-9158-45e9-9a22-ce98fda99902", "device": "/dev/sdb"}} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:42:16.851650 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-0882cd96-7f43-46c2-9002-6f664d734696 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] [instance: 7a4bf12e-c36e-425e-bd1f-181bd4326de3] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:16.857528 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0882cd96-7f43-46c2-9002-6f664d734696 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:16.857991 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0882cd96-7f43-46c2-9002-6f664d734696 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:16.858422 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0882cd96-7f43-46c2-9002-6f664d734696 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:16.859136 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0882cd96-7f43-46c2-9002-6f664d734696 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:16.859590 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0882cd96-7f43-46c2-9002-6f664d734696 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:16.860010 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0882cd96-7f43-46c2-9002-6f664d734696 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:17.403594 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-ff2ad6a7-6b39-4ef4-9b74-b0d1fd099829 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:17.404203 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-ff2ad6a7-6b39-4ef4-9b74-b0d1fd099829 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 2e049e53-afdd-42e1-ad0c-4805c1579f14] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:17.410534 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ff2ad6a7-6b39-4ef4-9b74-b0d1fd099829 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:17.411055 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ff2ad6a7-6b39-4ef4-9b74-b0d1fd099829 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:17.411490 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ff2ad6a7-6b39-4ef4-9b74-b0d1fd099829 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:17.412173 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ff2ad6a7-6b39-4ef4-9b74-b0d1fd099829 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:17.412624 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ff2ad6a7-6b39-4ef4-9b74-b0d1fd099829 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:17.413044 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ff2ad6a7-6b39-4ef4-9b74-b0d1fd099829 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:17.546072 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-ff2ad6a7-6b39-4ef4-9b74-b0d1fd099829 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:17.553610 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-ff2ad6a7-6b39-4ef4-9b74-b0d1fd099829 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14" status: 200 len: 1314 microversion: 2.1 time: 0.153885 Aug 24 07:42:17.554156 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 136/285] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:17 2022] GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:42:17.558819 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-c96a28dc-304e-437b-8d76-b81308dd60b6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:17.559405 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-c96a28dc-304e-437b-8d76-b81308dd60b6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:17.564893 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c96a28dc-304e-437b-8d76-b81308dd60b6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:17.565359 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c96a28dc-304e-437b-8d76-b81308dd60b6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:17.565779 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c96a28dc-304e-437b-8d76-b81308dd60b6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:17.566451 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c96a28dc-304e-437b-8d76-b81308dd60b6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:17.567036 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c96a28dc-304e-437b-8d76-b81308dd60b6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:17.567455 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c96a28dc-304e-437b-8d76-b81308dd60b6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:17.732221 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-c96a28dc-304e-437b-8d76-b81308dd60b6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:17.764385 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-c96a28dc-304e-437b-8d76-b81308dd60b6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1522 microversion: 2.1 time: 0.201022 Aug 24 07:42:17.765849 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 137/286] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:17 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:17.906941 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-0882cd96-7f43-46c2-9002-6f664d734696 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] 10.222.0.42 "POST /compute/v2.1/servers/7a4bf12e-c36e-425e-bd1f-181bd4326de3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.061983 Aug 24 07:42:17.907733 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 150/287] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Aug 24 07:42:16 2022] POST /compute/v2.1/servers/7a4bf12e-c36e-425e-bd1f-181bd4326de3/os-volume_attachments => generated 194 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:42:18.574541 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-b1aeee61-ca86-473f-9120-275c6ca31809 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:18.575169 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-b1aeee61-ca86-473f-9120-275c6ca31809 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 2e049e53-afdd-42e1-ad0c-4805c1579f14] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:18.581414 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b1aeee61-ca86-473f-9120-275c6ca31809 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:18.581895 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b1aeee61-ca86-473f-9120-275c6ca31809 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:18.582320 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b1aeee61-ca86-473f-9120-275c6ca31809 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:18.583061 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b1aeee61-ca86-473f-9120-275c6ca31809 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:18.583505 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b1aeee61-ca86-473f-9120-275c6ca31809 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:18.583946 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b1aeee61-ca86-473f-9120-275c6ca31809 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:18.715374 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-b1aeee61-ca86-473f-9120-275c6ca31809 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:18.723909 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-b1aeee61-ca86-473f-9120-275c6ca31809 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14" status: 200 len: 1314 microversion: 2.1 time: 0.153174 Aug 24 07:42:18.724574 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 138/288] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:18 2022] GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:18.787043 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-660c00f3-9567-4589-ad90-2fbc67102dfd tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:18.787740 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-660c00f3-9567-4589-ad90-2fbc67102dfd tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:18.794583 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-660c00f3-9567-4589-ad90-2fbc67102dfd tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:18.795116 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-660c00f3-9567-4589-ad90-2fbc67102dfd tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:18.795652 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-660c00f3-9567-4589-ad90-2fbc67102dfd tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:18.796364 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-660c00f3-9567-4589-ad90-2fbc67102dfd tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:18.796815 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-660c00f3-9567-4589-ad90-2fbc67102dfd tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:18.797239 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-660c00f3-9567-4589-ad90-2fbc67102dfd tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:19.017656 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-660c00f3-9567-4589-ad90-2fbc67102dfd tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:19.029559 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-660c00f3-9567-4589-ad90-2fbc67102dfd tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1522 microversion: 2.1 time: 0.244556 Aug 24 07:42:19.043049 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 151/289] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:18 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:19.745152 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-18c18304-16ed-4216-aaa8-3fc971afb9f0 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:19.745710 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-18c18304-16ed-4216-aaa8-3fc971afb9f0 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 2e049e53-afdd-42e1-ad0c-4805c1579f14] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:19.751854 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-18c18304-16ed-4216-aaa8-3fc971afb9f0 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:19.752333 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-18c18304-16ed-4216-aaa8-3fc971afb9f0 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:19.752762 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-18c18304-16ed-4216-aaa8-3fc971afb9f0 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:19.753448 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-18c18304-16ed-4216-aaa8-3fc971afb9f0 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:19.753928 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-18c18304-16ed-4216-aaa8-3fc971afb9f0 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:19.754374 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-18c18304-16ed-4216-aaa8-3fc971afb9f0 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:19.882461 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-18c18304-16ed-4216-aaa8-3fc971afb9f0 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:19.889943 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-18c18304-16ed-4216-aaa8-3fc971afb9f0 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14" status: 200 len: 1314 microversion: 2.1 time: 0.148856 Aug 24 07:42:19.890499 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 139/290] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:19 2022] GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:20.050041 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-0a458e1b-3d87-47fa-bbc8-3bd2b0a3c8cd tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:20.050649 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-0a458e1b-3d87-47fa-bbc8-3bd2b0a3c8cd tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:20.057363 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0a458e1b-3d87-47fa-bbc8-3bd2b0a3c8cd tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:20.057845 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0a458e1b-3d87-47fa-bbc8-3bd2b0a3c8cd tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:20.058280 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0a458e1b-3d87-47fa-bbc8-3bd2b0a3c8cd tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:20.059009 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0a458e1b-3d87-47fa-bbc8-3bd2b0a3c8cd tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:20.059463 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0a458e1b-3d87-47fa-bbc8-3bd2b0a3c8cd tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:20.059886 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0a458e1b-3d87-47fa-bbc8-3bd2b0a3c8cd tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:20.255203 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-0a458e1b-3d87-47fa-bbc8-3bd2b0a3c8cd tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:20.263036 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-0a458e1b-3d87-47fa-bbc8-3bd2b0a3c8cd tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1502 microversion: 2.1 time: 0.216756 Aug 24 07:42:20.263601 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 152/291] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:20 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1502 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:20.283850 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-4f7f3ba9-f715-4217-80c6-ae637d37873f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e556a6d4-69b5-4746-be08-b19d9f3da00e"}} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:42:20.286271 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-4f7f3ba9-f715-4217-80c6-ae637d37873f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:20.292081 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4f7f3ba9-f715-4217-80c6-ae637d37873f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:20.292538 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4f7f3ba9-f715-4217-80c6-ae637d37873f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:20.292967 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4f7f3ba9-f715-4217-80c6-ae637d37873f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:20.293648 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4f7f3ba9-f715-4217-80c6-ae637d37873f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:20.294094 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4f7f3ba9-f715-4217-80c6-ae637d37873f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:20.294511 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4f7f3ba9-f715-4217-80c6-ae637d37873f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:20.318523 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.wsgi [None req-4f7f3ba9-f715-4217-80c6-ae637d37873f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] HTTP exception thrown: Cannot 'attach_volume' instance 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 while it is in vm_state rescued Aug 24 07:42:20.320676 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-4f7f3ba9-f715-4217-80c6-ae637d37873f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Request method failure captured: Aug 24 07:42:20.320676 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: request: POST /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33/os-volume_attachments HTTP/1.1 Aug 24 07:42:20.320676 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept: application/json Aug 24 07:42:20.320676 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept-Encoding: identity Aug 24 07:42:20.320676 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Connection: close Aug 24 07:42:20.320676 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Length: 74 Aug 24 07:42:20.320676 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Type: application/json Aug 24 07:42:20.320676 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Host: 10.222.0.42 Aug 24 07:42:20.320676 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Openstack-System-Scope: None Aug 24 07:42:20.320676 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: User-Agent: python-urllib3/1.26.11 Aug 24 07:42:20.320676 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Auth-Token: gAAAAABjBdXj3OPdwVwNOikGz1pZEgQOCeh4GEqP5ntGxH9tZbilOI8irB2hmt3_ZpPS8CXIWEa2XHNjlUSveY2TpFHTN1ywO6y85GK4OQMHI4fYrZV7Il0xWKACBF1PBAEg2tFw9XsIk_TQrLA7G9okeYuatkKWc1A69fCtYrVWLZK-735LZbU Aug 24 07:42:20.320676 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Id: None Aug 24 07:42:20.320676 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Name: None Aug 24 07:42:20.320676 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Identity-Status: Confirmed Aug 24 07:42:20.320676 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Is-Admin-Project: True Aug 24 07:42:20.320676 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Id: default Aug 24 07:42:20.320676 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Name: Default Aug 24 07:42:20.320676 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Id: d5672bdc355c4f63885138bd9c7f3497 Aug 24 07:42:20.320676 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1449296042 Aug 24 07:42:20.320676 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Role: reader,member Aug 24 07:42:20.320676 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Roles: reader,member Aug 24 07:42:20.321959 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d5672bdc355c4f63885138bd9c7f3497"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d5672bdc355c4f63885138bd9c7f3497", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d5672bdc355c4f63885138bd9c7f3497"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d5672bdc355c4f63885138bd9c7f3497"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:42:20.321959 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1449296042 Aug 24 07:42:20.321959 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Id: d5672bdc355c4f63885138bd9c7f3497 Aug 24 07:42:20.321959 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1449296042 Aug 24 07:42:20.321959 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User: tempest-ServerRescueNegativeTestJSON-1449296042-project Aug 24 07:42:20.321959 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Id: default Aug 24 07:42:20.321959 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Name: Default Aug 24 07:42:20.321959 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Id: ea609a2504e64f6f9380061080976a6e Aug 24 07:42:20.321959 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1449296042-project Aug 24 07:42:20.321959 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Aug 24 07:42:20.321959 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: {"volumeAttachment": {"volumeId": "e556a6d4-69b5-4746-be08-b19d9f3da00e"}} Aug 24 07:42:20.321959 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: method: > Aug 24 07:42:20.322805 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: exception: Cannot 'attach_volume' instance 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 while it is in vm_state rescued Aug 24 07:42:20.322805 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: action_args: {'server_id': '2efe00bb-3dbb-42d6-82ac-4f1045ec5f33', 'body': {'volumeAttachment': {'volumeId': 'e556a6d4-69b5-4746-be08-b19d9f3da00e'}}} Aug 24 07:42:20.322805 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:42:20.322805 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:42:20.322805 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 07:42:20.322805 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 07:42:20.322805 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 07:42:20.322805 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 07:42:20.322805 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 07:42:20.322805 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 07:42:20.322805 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 24 07:42:20.322805 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:42:20.322805 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:42:20.322805 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:42:20.322805 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:42:20.322805 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:42:20.322805 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:42:20.322805 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:42:20.322805 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:42:20.324058 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:42:20.324058 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:42:20.324058 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 07:42:20.324058 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 07:42:20.324058 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 07:42:20.324058 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 07:42:20.324058 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 07:42:20.324058 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 07:42:20.324058 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 24 07:42:20.324058 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 07:42:20.324058 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 07:42:20.324058 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 07:42:20.324058 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 while it is in vm_state rescued Aug 24 07:42:20.324058 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:42:20.324058 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:42:20.324058 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:42:20.324058 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:42:20.324058 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:42:20.324058 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:42:20.325345 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:42:20.325345 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:42:20.325345 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 while it is in vm_state rescued Aug 24 07:42:20.325345 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:42:20.325345 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-4f7f3ba9-f715-4217-80c6-ae637d37873f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Returning 409 to user: Cannot 'attach_volume' instance 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 while it is in vm_state rescued {{(pid=127113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:42:20.325345 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-4f7f3ba9-f715-4217-80c6-ae637d37873f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "POST /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042357 Aug 24 07:42:20.325345 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 140/292] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Aug 24 07:42:20 2022] POST /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 07:42:20.334216 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-42266a89-5bdd-4d4f-8c4a-1bb07e2f16e0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:42:20.335076 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-42266a89-5bdd-4d4f-8c4a-1bb07e2f16e0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:20.341069 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-42266a89-5bdd-4d4f-8c4a-1bb07e2f16e0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:20.341554 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-42266a89-5bdd-4d4f-8c4a-1bb07e2f16e0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:20.341988 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-42266a89-5bdd-4d4f-8c4a-1bb07e2f16e0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:20.342682 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-42266a89-5bdd-4d4f-8c4a-1bb07e2f16e0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:20.343166 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-42266a89-5bdd-4d4f-8c4a-1bb07e2f16e0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:20.343588 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-42266a89-5bdd-4d4f-8c4a-1bb07e2f16e0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:20.410267 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-42266a89-5bdd-4d4f-8c4a-1bb07e2f16e0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "POST /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33/action" status: 202 len: 0 microversion: 2.1 time: 0.082037 Aug 24 07:42:20.411189 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 153/293] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 24 07:42:20 2022] POST /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 07:42:20.420507 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-2190064e-ccdb-4293-9a5f-c80381a6c27c tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:20.421433 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-2190064e-ccdb-4293-9a5f-c80381a6c27c tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:20.427568 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2190064e-ccdb-4293-9a5f-c80381a6c27c tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:20.428401 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2190064e-ccdb-4293-9a5f-c80381a6c27c tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:20.429055 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2190064e-ccdb-4293-9a5f-c80381a6c27c tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:20.430074 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2190064e-ccdb-4293-9a5f-c80381a6c27c tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:20.430857 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2190064e-ccdb-4293-9a5f-c80381a6c27c tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:20.431285 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2190064e-ccdb-4293-9a5f-c80381a6c27c tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:20.588712 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-2190064e-ccdb-4293-9a5f-c80381a6c27c tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:20.599296 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-2190064e-ccdb-4293-9a5f-c80381a6c27c tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1510 microversion: 2.1 time: 0.183308 Aug 24 07:42:20.600357 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 141/294] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:20 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1510 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:20.884570 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [req-1d97559b-1726-49ac-99d1-68cb6151673d req-45cacff6-728b-49b4-8947-d03a1d28faf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e049e53-afdd-42e1-ad0c-4805c1579f14", "name": "network-vif-plugged", "status": "completed", "tag": "9dfd157f-ec13-4a0a-ba1c-2ff8ed089c8a"}]} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:42:20.895377 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-1d97559b-1726-49ac-99d1-68cb6151673d req-45cacff6-728b-49b4-8947-d03a1d28faf0 service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:20.896065 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-1d97559b-1726-49ac-99d1-68cb6151673d req-45cacff6-728b-49b4-8947-d03a1d28faf0 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:20.896675 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-1d97559b-1726-49ac-99d1-68cb6151673d req-45cacff6-728b-49b4-8947-d03a1d28faf0 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:20.908768 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.compute.server_external_events [req-1d97559b-1726-49ac-99d1-68cb6151673d req-45cacff6-728b-49b4-8947-d03a1d28faf0 service nova] Creating event network-vif-plugged:9dfd157f-ec13-4a0a-ba1c-2ff8ed089c8a for instance 2e049e53-afdd-42e1-ad0c-4805c1579f14 on hv-cinder-85427 Aug 24 07:42:20.913982 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [req-1d97559b-1726-49ac-99d1-68cb6151673d req-45cacff6-728b-49b4-8947-d03a1d28faf0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033833 Aug 24 07:42:20.914239 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-f4a70b79-4f83-4be1-b17a-9393d427214d tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:20.914837 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 154/295] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:42:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:42:20.915910 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-f4a70b79-4f83-4be1-b17a-9393d427214d tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 2e049e53-afdd-42e1-ad0c-4805c1579f14] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:20.923642 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f4a70b79-4f83-4be1-b17a-9393d427214d tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:20.924265 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f4a70b79-4f83-4be1-b17a-9393d427214d tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:20.924908 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f4a70b79-4f83-4be1-b17a-9393d427214d tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:20.925871 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f4a70b79-4f83-4be1-b17a-9393d427214d tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:20.927128 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f4a70b79-4f83-4be1-b17a-9393d427214d tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:20.927619 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f4a70b79-4f83-4be1-b17a-9393d427214d tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:21.119286 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-f4a70b79-4f83-4be1-b17a-9393d427214d tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:21.129603 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-f4a70b79-4f83-4be1-b17a-9393d427214d tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14" status: 200 len: 1314 microversion: 2.1 time: 0.221723 Aug 24 07:42:21.130470 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 142/296] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:20 2022] GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:42:21.621143 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-64845478-18fb-42cf-a3dc-9b4343165e94 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:21.621826 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-64845478-18fb-42cf-a3dc-9b4343165e94 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:21.628595 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-64845478-18fb-42cf-a3dc-9b4343165e94 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:21.629066 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-64845478-18fb-42cf-a3dc-9b4343165e94 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:21.629491 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-64845478-18fb-42cf-a3dc-9b4343165e94 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:21.630164 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-64845478-18fb-42cf-a3dc-9b4343165e94 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:21.630617 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-64845478-18fb-42cf-a3dc-9b4343165e94 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:21.631061 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-64845478-18fb-42cf-a3dc-9b4343165e94 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:21.707350 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell0:SELECT=2 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:42:21.765847 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-64845478-18fb-42cf-a3dc-9b4343165e94 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:21.775731 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-64845478-18fb-42cf-a3dc-9b4343165e94 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1510 microversion: 2.1 time: 0.158729 Aug 24 07:42:21.778211 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 155/297] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:21 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:22.153285 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-d797e004-4a25-41ae-9853-28511cd13d56 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:22.153885 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-d797e004-4a25-41ae-9853-28511cd13d56 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 2e049e53-afdd-42e1-ad0c-4805c1579f14] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:22.155865 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell0:SELECT=2 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:42:22.156682 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell0:SELECT=6 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:42:22.162884 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d797e004-4a25-41ae-9853-28511cd13d56 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:22.163394 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d797e004-4a25-41ae-9853-28511cd13d56 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:22.163823 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d797e004-4a25-41ae-9853-28511cd13d56 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:22.164531 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d797e004-4a25-41ae-9853-28511cd13d56 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:22.164977 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d797e004-4a25-41ae-9853-28511cd13d56 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:22.165401 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d797e004-4a25-41ae-9853-28511cd13d56 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:22.297908 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-d797e004-4a25-41ae-9853-28511cd13d56 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:22.305713 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-d797e004-4a25-41ae-9853-28511cd13d56 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14" status: 200 len: 1314 microversion: 2.1 time: 0.155997 Aug 24 07:42:22.306265 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 143/298] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:22 2022] GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:22.796892 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-ad19bb1d-49f7-4ce8-b739-5986b6d6d311 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:22.797501 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-ad19bb1d-49f7-4ce8-b739-5986b6d6d311 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:22.804505 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ad19bb1d-49f7-4ce8-b739-5986b6d6d311 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:22.804992 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ad19bb1d-49f7-4ce8-b739-5986b6d6d311 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:22.805681 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ad19bb1d-49f7-4ce8-b739-5986b6d6d311 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:22.806368 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ad19bb1d-49f7-4ce8-b739-5986b6d6d311 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:22.806853 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ad19bb1d-49f7-4ce8-b739-5986b6d6d311 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:22.807276 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ad19bb1d-49f7-4ce8-b739-5986b6d6d311 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:22.938839 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-ad19bb1d-49f7-4ce8-b739-5986b6d6d311 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:22.947698 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-ad19bb1d-49f7-4ce8-b739-5986b6d6d311 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1510 microversion: 2.1 time: 0.154632 Aug 24 07:42:22.948249 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 156/299] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:22 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:23.325300 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-3c8cdcd8-3fec-47ad-b6b9-ccaec12ff7c7 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:23.325898 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-3c8cdcd8-3fec-47ad-b6b9-ccaec12ff7c7 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 2e049e53-afdd-42e1-ad0c-4805c1579f14] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:23.331845 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3c8cdcd8-3fec-47ad-b6b9-ccaec12ff7c7 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:23.332319 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3c8cdcd8-3fec-47ad-b6b9-ccaec12ff7c7 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:23.332746 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3c8cdcd8-3fec-47ad-b6b9-ccaec12ff7c7 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:23.333534 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3c8cdcd8-3fec-47ad-b6b9-ccaec12ff7c7 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:23.333985 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3c8cdcd8-3fec-47ad-b6b9-ccaec12ff7c7 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:23.334402 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3c8cdcd8-3fec-47ad-b6b9-ccaec12ff7c7 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:23.466219 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-3c8cdcd8-3fec-47ad-b6b9-ccaec12ff7c7 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:23.474261 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-3c8cdcd8-3fec-47ad-b6b9-ccaec12ff7c7 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14" status: 200 len: 1314 microversion: 2.1 time: 0.152840 Aug 24 07:42:23.474847 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 144/300] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:23 2022] GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:23.968150 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-9171ecb0-4f4d-47b3-bed8-d4c5077f399e tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:23.968751 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-9171ecb0-4f4d-47b3-bed8-d4c5077f399e tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:23.975377 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9171ecb0-4f4d-47b3-bed8-d4c5077f399e tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:23.975854 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9171ecb0-4f4d-47b3-bed8-d4c5077f399e tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:23.976317 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9171ecb0-4f4d-47b3-bed8-d4c5077f399e tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:23.977052 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9171ecb0-4f4d-47b3-bed8-d4c5077f399e tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:23.977501 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9171ecb0-4f4d-47b3-bed8-d4c5077f399e tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:23.977920 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9171ecb0-4f4d-47b3-bed8-d4c5077f399e tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:24.106815 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-9171ecb0-4f4d-47b3-bed8-d4c5077f399e tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:24.114762 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-9171ecb0-4f4d-47b3-bed8-d4c5077f399e tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1510 microversion: 2.1 time: 0.150406 Aug 24 07:42:24.115321 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 157/301] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:23 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:24.495796 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-1569574f-3718-4984-96a3-9e227a17e59e tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:24.496392 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-1569574f-3718-4984-96a3-9e227a17e59e tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 2e049e53-afdd-42e1-ad0c-4805c1579f14] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:24.502219 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1569574f-3718-4984-96a3-9e227a17e59e tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:24.503323 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1569574f-3718-4984-96a3-9e227a17e59e tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:24.503764 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1569574f-3718-4984-96a3-9e227a17e59e tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:24.504420 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1569574f-3718-4984-96a3-9e227a17e59e tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:24.504859 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1569574f-3718-4984-96a3-9e227a17e59e tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:24.505272 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1569574f-3718-4984-96a3-9e227a17e59e tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:24.630576 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-1569574f-3718-4984-96a3-9e227a17e59e tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:24.637981 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-1569574f-3718-4984-96a3-9e227a17e59e tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14" status: 200 len: 1314 microversion: 2.1 time: 0.145977 Aug 24 07:42:24.638536 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 145/302] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:24 2022] GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:25.137068 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-e68336de-ff52-448e-be24-190611c1d604 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:25.137673 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-e68336de-ff52-448e-be24-190611c1d604 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:25.144595 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e68336de-ff52-448e-be24-190611c1d604 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:25.145096 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e68336de-ff52-448e-be24-190611c1d604 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:25.145527 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e68336de-ff52-448e-be24-190611c1d604 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:25.146206 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e68336de-ff52-448e-be24-190611c1d604 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:25.147128 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e68336de-ff52-448e-be24-190611c1d604 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:25.147128 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e68336de-ff52-448e-be24-190611c1d604 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:25.276532 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-e68336de-ff52-448e-be24-190611c1d604 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:25.284697 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-e68336de-ff52-448e-be24-190611c1d604 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1510 microversion: 2.1 time: 0.151542 Aug 24 07:42:25.285244 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 158/303] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:25 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:25.658193 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-de6b6a43-0898-408d-a787-7c5944558df8 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:25.658813 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-de6b6a43-0898-408d-a787-7c5944558df8 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 2e049e53-afdd-42e1-ad0c-4805c1579f14] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:25.664892 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-de6b6a43-0898-408d-a787-7c5944558df8 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:25.665361 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-de6b6a43-0898-408d-a787-7c5944558df8 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:25.665783 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-de6b6a43-0898-408d-a787-7c5944558df8 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:25.666503 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-de6b6a43-0898-408d-a787-7c5944558df8 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:25.666989 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-de6b6a43-0898-408d-a787-7c5944558df8 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:25.667386 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-de6b6a43-0898-408d-a787-7c5944558df8 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:25.671253 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell1:SELECT=100 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:42:25.796038 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-de6b6a43-0898-408d-a787-7c5944558df8 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:25.804217 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-de6b6a43-0898-408d-a787-7c5944558df8 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14" status: 200 len: 1314 microversion: 2.1 time: 0.149815 Aug 24 07:42:25.804778 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 146/304] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:25 2022] GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:26.305243 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-b692369e-cd97-4ad7-a92a-48d0a2aee958 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:26.306190 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-b692369e-cd97-4ad7-a92a-48d0a2aee958 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:26.312722 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b692369e-cd97-4ad7-a92a-48d0a2aee958 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:26.313198 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b692369e-cd97-4ad7-a92a-48d0a2aee958 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:26.313832 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b692369e-cd97-4ad7-a92a-48d0a2aee958 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:26.314595 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b692369e-cd97-4ad7-a92a-48d0a2aee958 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:26.315584 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b692369e-cd97-4ad7-a92a-48d0a2aee958 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:26.316005 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b692369e-cd97-4ad7-a92a-48d0a2aee958 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:26.448414 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-b692369e-cd97-4ad7-a92a-48d0a2aee958 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:26.456745 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-b692369e-cd97-4ad7-a92a-48d0a2aee958 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1510 microversion: 2.1 time: 0.155579 Aug 24 07:42:26.457288 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 159/305] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:26 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:26.825478 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-683d495e-9373-4379-93f5-0219159ac35f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:26.826017 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-683d495e-9373-4379-93f5-0219159ac35f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 2e049e53-afdd-42e1-ad0c-4805c1579f14] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:26.831918 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-683d495e-9373-4379-93f5-0219159ac35f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:26.832398 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-683d495e-9373-4379-93f5-0219159ac35f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:26.832833 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-683d495e-9373-4379-93f5-0219159ac35f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:26.833518 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-683d495e-9373-4379-93f5-0219159ac35f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:26.833970 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-683d495e-9373-4379-93f5-0219159ac35f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:26.834392 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-683d495e-9373-4379-93f5-0219159ac35f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:26.958687 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-683d495e-9373-4379-93f5-0219159ac35f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:26.966213 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-683d495e-9373-4379-93f5-0219159ac35f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14" status: 200 len: 1314 microversion: 2.1 time: 0.144689 Aug 24 07:42:26.966788 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 147/306] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:26 2022] GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:27.476991 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-7a79b45f-a903-40b3-bbe0-7497cd256bab tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:27.477599 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-7a79b45f-a903-40b3-bbe0-7497cd256bab tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:27.484089 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7a79b45f-a903-40b3-bbe0-7497cd256bab tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:27.484568 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7a79b45f-a903-40b3-bbe0-7497cd256bab tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:27.485000 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7a79b45f-a903-40b3-bbe0-7497cd256bab tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:27.485695 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7a79b45f-a903-40b3-bbe0-7497cd256bab tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:27.486146 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7a79b45f-a903-40b3-bbe0-7497cd256bab tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:27.486566 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7a79b45f-a903-40b3-bbe0-7497cd256bab tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:27.615477 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-7a79b45f-a903-40b3-bbe0-7497cd256bab tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:27.618854 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:42:27.623409 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-7a79b45f-a903-40b3-bbe0-7497cd256bab tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1510 microversion: 2.1 time: 0.150313 Aug 24 07:42:27.623973 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 160/307] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:27 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:27.987593 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-5e56d75f-09c2-4fc5-8ea5-045ec5a3a8a7 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:27.988274 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-5e56d75f-09c2-4fc5-8ea5-045ec5a3a8a7 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 2e049e53-afdd-42e1-ad0c-4805c1579f14] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:27.994190 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5e56d75f-09c2-4fc5-8ea5-045ec5a3a8a7 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:27.994663 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5e56d75f-09c2-4fc5-8ea5-045ec5a3a8a7 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:27.995126 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5e56d75f-09c2-4fc5-8ea5-045ec5a3a8a7 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:27.995803 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5e56d75f-09c2-4fc5-8ea5-045ec5a3a8a7 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:27.996250 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5e56d75f-09c2-4fc5-8ea5-045ec5a3a8a7 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:27.996666 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5e56d75f-09c2-4fc5-8ea5-045ec5a3a8a7 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:28.125592 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-5e56d75f-09c2-4fc5-8ea5-045ec5a3a8a7 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:28.133988 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-5e56d75f-09c2-4fc5-8ea5-045ec5a3a8a7 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14" status: 200 len: 1314 microversion: 2.1 time: 0.150712 Aug 24 07:42:28.134552 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 148/308] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:27 2022] GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:28.645187 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-41555448-a89d-4e66-af7b-42d56a05d9f1 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:28.645806 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-41555448-a89d-4e66-af7b-42d56a05d9f1 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:28.652521 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-41555448-a89d-4e66-af7b-42d56a05d9f1 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:28.653110 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-41555448-a89d-4e66-af7b-42d56a05d9f1 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:28.653663 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-41555448-a89d-4e66-af7b-42d56a05d9f1 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:28.654384 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-41555448-a89d-4e66-af7b-42d56a05d9f1 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:28.654858 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-41555448-a89d-4e66-af7b-42d56a05d9f1 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:28.655217 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-41555448-a89d-4e66-af7b-42d56a05d9f1 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:28.786164 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-41555448-a89d-4e66-af7b-42d56a05d9f1 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:28.793631 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-41555448-a89d-4e66-af7b-42d56a05d9f1 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1510 microversion: 2.1 time: 0.153363 Aug 24 07:42:28.794180 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 161/309] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:28 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:29.154329 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-bc50fc50-87ad-4482-a6c2-c50043e5ebce tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:29.154963 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-bc50fc50-87ad-4482-a6c2-c50043e5ebce tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 2e049e53-afdd-42e1-ad0c-4805c1579f14] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:29.161383 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bc50fc50-87ad-4482-a6c2-c50043e5ebce tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:29.161859 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bc50fc50-87ad-4482-a6c2-c50043e5ebce tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:29.162295 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bc50fc50-87ad-4482-a6c2-c50043e5ebce tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:29.163007 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bc50fc50-87ad-4482-a6c2-c50043e5ebce tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:29.163461 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bc50fc50-87ad-4482-a6c2-c50043e5ebce tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:29.163881 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bc50fc50-87ad-4482-a6c2-c50043e5ebce tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:29.289472 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-bc50fc50-87ad-4482-a6c2-c50043e5ebce tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:29.297108 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-bc50fc50-87ad-4482-a6c2-c50043e5ebce tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14" status: 200 len: 1314 microversion: 2.1 time: 0.146703 Aug 24 07:42:29.297662 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 149/310] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:29 2022] GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:29.814958 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-30ca36b2-d673-41f3-9866-41aca83ce40b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:29.815606 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-30ca36b2-d673-41f3-9866-41aca83ce40b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:29.828801 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-30ca36b2-d673-41f3-9866-41aca83ce40b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:29.829294 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-30ca36b2-d673-41f3-9866-41aca83ce40b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:29.829731 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-30ca36b2-d673-41f3-9866-41aca83ce40b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:29.830424 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-30ca36b2-d673-41f3-9866-41aca83ce40b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:29.831418 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-30ca36b2-d673-41f3-9866-41aca83ce40b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:29.832238 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-30ca36b2-d673-41f3-9866-41aca83ce40b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:30.014814 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-30ca36b2-d673-41f3-9866-41aca83ce40b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:30.024918 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-30ca36b2-d673-41f3-9866-41aca83ce40b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1510 microversion: 2.1 time: 0.213631 Aug 24 07:42:30.025803 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 162/311] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:29 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1510 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:30.319006 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-4bf4d3aa-163f-4765-b7de-f407ee31140d tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:30.319609 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-4bf4d3aa-163f-4765-b7de-f407ee31140d tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 2e049e53-afdd-42e1-ad0c-4805c1579f14] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:30.325497 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4bf4d3aa-163f-4765-b7de-f407ee31140d tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:30.325968 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4bf4d3aa-163f-4765-b7de-f407ee31140d tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:30.326393 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4bf4d3aa-163f-4765-b7de-f407ee31140d tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:30.327096 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4bf4d3aa-163f-4765-b7de-f407ee31140d tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:30.327538 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4bf4d3aa-163f-4765-b7de-f407ee31140d tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:30.327971 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4bf4d3aa-163f-4765-b7de-f407ee31140d tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:30.462426 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-4bf4d3aa-163f-4765-b7de-f407ee31140d tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:30.470627 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-4bf4d3aa-163f-4765-b7de-f407ee31140d tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14" status: 200 len: 1314 microversion: 2.1 time: 0.155437 Aug 24 07:42:30.470888 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 150/312] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:30 2022] GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:31.045754 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-e9215318-b2db-4657-8e99-18a64b517d13 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:31.046549 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-e9215318-b2db-4657-8e99-18a64b517d13 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:31.053287 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e9215318-b2db-4657-8e99-18a64b517d13 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:31.053878 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e9215318-b2db-4657-8e99-18a64b517d13 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:31.054410 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e9215318-b2db-4657-8e99-18a64b517d13 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:31.055146 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e9215318-b2db-4657-8e99-18a64b517d13 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:31.055870 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e9215318-b2db-4657-8e99-18a64b517d13 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:31.056289 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e9215318-b2db-4657-8e99-18a64b517d13 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:31.257095 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-e9215318-b2db-4657-8e99-18a64b517d13 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:31.267542 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-e9215318-b2db-4657-8e99-18a64b517d13 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1510 microversion: 2.1 time: 0.225932 Aug 24 07:42:31.269425 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 163/313] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:31 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1510 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:31.491301 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-4903824f-ab7a-4db8-9d36-d67be79d380f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:31.492604 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-4903824f-ab7a-4db8-9d36-d67be79d380f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 2e049e53-afdd-42e1-ad0c-4805c1579f14] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:31.499339 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4903824f-ab7a-4db8-9d36-d67be79d380f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:31.500097 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4903824f-ab7a-4db8-9d36-d67be79d380f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:31.500923 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4903824f-ab7a-4db8-9d36-d67be79d380f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:31.501829 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4903824f-ab7a-4db8-9d36-d67be79d380f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:31.502517 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4903824f-ab7a-4db8-9d36-d67be79d380f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:31.503738 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4903824f-ab7a-4db8-9d36-d67be79d380f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:31.655656 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-4903824f-ab7a-4db8-9d36-d67be79d380f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:31.663363 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-4903824f-ab7a-4db8-9d36-d67be79d380f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14" status: 200 len: 1314 microversion: 2.1 time: 0.176255 Aug 24 07:42:31.664580 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 151/314] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:31 2022] GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:32.290301 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-b59ca58c-93bc-4718-8293-4ae8a4685679 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:32.294256 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-b59ca58c-93bc-4718-8293-4ae8a4685679 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:32.308528 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b59ca58c-93bc-4718-8293-4ae8a4685679 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:32.309085 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b59ca58c-93bc-4718-8293-4ae8a4685679 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:32.309453 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b59ca58c-93bc-4718-8293-4ae8a4685679 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:32.310167 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b59ca58c-93bc-4718-8293-4ae8a4685679 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:32.310627 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b59ca58c-93bc-4718-8293-4ae8a4685679 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:32.311079 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b59ca58c-93bc-4718-8293-4ae8a4685679 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:32.570106 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-b59ca58c-93bc-4718-8293-4ae8a4685679 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:32.577777 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-b59ca58c-93bc-4718-8293-4ae8a4685679 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1510 microversion: 2.1 time: 0.291483 Aug 24 07:42:32.578626 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 164/315] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:32 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1510 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:32.684151 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-c112cacc-7f6a-4509-98d1-0827c191bb96 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:32.685055 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-c112cacc-7f6a-4509-98d1-0827c191bb96 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 2e049e53-afdd-42e1-ad0c-4805c1579f14] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:32.687295 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:42:32.692696 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c112cacc-7f6a-4509-98d1-0827c191bb96 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:32.693174 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c112cacc-7f6a-4509-98d1-0827c191bb96 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:32.693604 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c112cacc-7f6a-4509-98d1-0827c191bb96 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:32.694283 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c112cacc-7f6a-4509-98d1-0827c191bb96 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:32.694756 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c112cacc-7f6a-4509-98d1-0827c191bb96 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:32.695259 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c112cacc-7f6a-4509-98d1-0827c191bb96 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:32.842653 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-c112cacc-7f6a-4509-98d1-0827c191bb96 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:32.851813 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-c112cacc-7f6a-4509-98d1-0827c191bb96 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14" status: 200 len: 1314 microversion: 2.1 time: 0.172039 Aug 24 07:42:32.852732 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 152/316] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:32 2022] GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:33.601301 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-767a12f3-a557-4af4-9b94-98b9abd6555a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:33.602845 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-767a12f3-a557-4af4-9b94-98b9abd6555a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:33.609820 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-767a12f3-a557-4af4-9b94-98b9abd6555a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:33.610408 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-767a12f3-a557-4af4-9b94-98b9abd6555a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:33.610930 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-767a12f3-a557-4af4-9b94-98b9abd6555a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:33.611900 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-767a12f3-a557-4af4-9b94-98b9abd6555a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:33.612472 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-767a12f3-a557-4af4-9b94-98b9abd6555a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:33.612958 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-767a12f3-a557-4af4-9b94-98b9abd6555a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:33.773826 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-767a12f3-a557-4af4-9b94-98b9abd6555a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:33.783184 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-767a12f3-a557-4af4-9b94-98b9abd6555a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1510 microversion: 2.1 time: 0.187077 Aug 24 07:42:33.783790 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 165/317] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:33 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1510 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:33.875262 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-08cfce05-2d92-4fab-9ed0-5fb5f3ac9369 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:33.875880 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-08cfce05-2d92-4fab-9ed0-5fb5f3ac9369 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 2e049e53-afdd-42e1-ad0c-4805c1579f14] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:33.885363 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-08cfce05-2d92-4fab-9ed0-5fb5f3ac9369 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:33.886086 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-08cfce05-2d92-4fab-9ed0-5fb5f3ac9369 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:33.886907 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-08cfce05-2d92-4fab-9ed0-5fb5f3ac9369 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:33.888323 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-08cfce05-2d92-4fab-9ed0-5fb5f3ac9369 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:33.889590 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-08cfce05-2d92-4fab-9ed0-5fb5f3ac9369 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:33.890224 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-08cfce05-2d92-4fab-9ed0-5fb5f3ac9369 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:34.139416 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-08cfce05-2d92-4fab-9ed0-5fb5f3ac9369 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:34.157903 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-08cfce05-2d92-4fab-9ed0-5fb5f3ac9369 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14" status: 200 len: 1314 microversion: 2.1 time: 0.288912 Aug 24 07:42:34.158448 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 153/318] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:33 2022] GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14 => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:34.804449 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-030c9db2-f06a-40e1-9c54-de0d98079206 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:34.805158 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-030c9db2-f06a-40e1-9c54-de0d98079206 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:34.812066 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-030c9db2-f06a-40e1-9c54-de0d98079206 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:34.812555 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-030c9db2-f06a-40e1-9c54-de0d98079206 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:34.812987 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-030c9db2-f06a-40e1-9c54-de0d98079206 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:34.813680 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-030c9db2-f06a-40e1-9c54-de0d98079206 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:34.814477 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-030c9db2-f06a-40e1-9c54-de0d98079206 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:34.815119 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-030c9db2-f06a-40e1-9c54-de0d98079206 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:34.960732 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-030c9db2-f06a-40e1-9c54-de0d98079206 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:34.969559 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-030c9db2-f06a-40e1-9c54-de0d98079206 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1510 microversion: 2.1 time: 0.169332 Aug 24 07:42:34.973243 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 166/319] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:34 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1510 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:35.182777 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-cbc793e8-9ec8-4df0-bd2e-be24ba4e32f8 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:35.184007 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-cbc793e8-9ec8-4df0-bd2e-be24ba4e32f8 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 2e049e53-afdd-42e1-ad0c-4805c1579f14] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:35.194666 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-cbc793e8-9ec8-4df0-bd2e-be24ba4e32f8 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:35.195266 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-cbc793e8-9ec8-4df0-bd2e-be24ba4e32f8 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:35.195766 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-cbc793e8-9ec8-4df0-bd2e-be24ba4e32f8 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:35.196535 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-cbc793e8-9ec8-4df0-bd2e-be24ba4e32f8 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:35.197089 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-cbc793e8-9ec8-4df0-bd2e-be24ba4e32f8 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:35.197572 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-cbc793e8-9ec8-4df0-bd2e-be24ba4e32f8 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:35.379823 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-cbc793e8-9ec8-4df0-bd2e-be24ba4e32f8 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:35.390564 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-cbc793e8-9ec8-4df0-bd2e-be24ba4e32f8 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14" status: 200 len: 1314 microversion: 2.1 time: 0.213950 Aug 24 07:42:35.391302 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 154/320] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:35 2022] GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:35.992229 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-fafccab9-378d-43b4-85a2-8b7cbfcadbe6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:35.992967 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-fafccab9-378d-43b4-85a2-8b7cbfcadbe6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:35.999546 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fafccab9-378d-43b4-85a2-8b7cbfcadbe6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:36.000031 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fafccab9-378d-43b4-85a2-8b7cbfcadbe6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:36.000458 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fafccab9-378d-43b4-85a2-8b7cbfcadbe6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:36.001155 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fafccab9-378d-43b4-85a2-8b7cbfcadbe6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:36.001777 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fafccab9-378d-43b4-85a2-8b7cbfcadbe6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:36.002203 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fafccab9-378d-43b4-85a2-8b7cbfcadbe6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:36.321000 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-fafccab9-378d-43b4-85a2-8b7cbfcadbe6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:36.332651 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-fafccab9-378d-43b4-85a2-8b7cbfcadbe6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1510 microversion: 2.1 time: 0.344267 Aug 24 07:42:36.333578 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 167/321] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:35 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1510 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:36.411844 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-f72d5666-c9dd-425e-a19e-43fb48cdfef3 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:36.412436 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-f72d5666-c9dd-425e-a19e-43fb48cdfef3 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 2e049e53-afdd-42e1-ad0c-4805c1579f14] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:36.419451 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f72d5666-c9dd-425e-a19e-43fb48cdfef3 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:36.419843 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f72d5666-c9dd-425e-a19e-43fb48cdfef3 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:36.420451 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f72d5666-c9dd-425e-a19e-43fb48cdfef3 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:36.421148 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f72d5666-c9dd-425e-a19e-43fb48cdfef3 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:36.421586 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f72d5666-c9dd-425e-a19e-43fb48cdfef3 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:36.422160 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f72d5666-c9dd-425e-a19e-43fb48cdfef3 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:36.846368 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-f72d5666-c9dd-425e-a19e-43fb48cdfef3 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:36.854884 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-f72d5666-c9dd-425e-a19e-43fb48cdfef3 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14" status: 200 len: 1314 microversion: 2.1 time: 0.447144 Aug 24 07:42:36.855882 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 155/322] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:36 2022] GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14 => generated 1314 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:37.353966 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-64233d8d-e5bc-493e-83a4-2c4e702609de tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:37.354570 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-64233d8d-e5bc-493e-83a4-2c4e702609de tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:37.361214 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-64233d8d-e5bc-493e-83a4-2c4e702609de tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:37.361952 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-64233d8d-e5bc-493e-83a4-2c4e702609de tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:37.362580 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-64233d8d-e5bc-493e-83a4-2c4e702609de tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:37.363535 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-64233d8d-e5bc-493e-83a4-2c4e702609de tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:37.364189 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-64233d8d-e5bc-493e-83a4-2c4e702609de tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:37.364791 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-64233d8d-e5bc-493e-83a4-2c4e702609de tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:37.702602 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-64233d8d-e5bc-493e-83a4-2c4e702609de tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:37.717227 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-64233d8d-e5bc-493e-83a4-2c4e702609de tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1510 microversion: 2.1 time: 0.367099 Aug 24 07:42:37.732909 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 168/323] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:37 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1510 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:37.877660 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-038c0f6e-38db-4c01-994d-d2b1604dd2e7 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:37.879721 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-038c0f6e-38db-4c01-994d-d2b1604dd2e7 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 2e049e53-afdd-42e1-ad0c-4805c1579f14] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:37.886051 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-038c0f6e-38db-4c01-994d-d2b1604dd2e7 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:37.886921 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-038c0f6e-38db-4c01-994d-d2b1604dd2e7 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:37.887712 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-038c0f6e-38db-4c01-994d-d2b1604dd2e7 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:37.888635 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-038c0f6e-38db-4c01-994d-d2b1604dd2e7 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:37.889478 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-038c0f6e-38db-4c01-994d-d2b1604dd2e7 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:37.890111 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-038c0f6e-38db-4c01-994d-d2b1604dd2e7 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:38.054391 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-038c0f6e-38db-4c01-994d-d2b1604dd2e7 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:38.064670 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-038c0f6e-38db-4c01-994d-d2b1604dd2e7 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14" status: 200 len: 1314 microversion: 2.1 time: 0.190703 Aug 24 07:42:38.066755 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 156/324] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:37 2022] GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:38.737553 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-6264dd8e-a37d-4002-9b1c-b19113de9491 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:38.738757 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-6264dd8e-a37d-4002-9b1c-b19113de9491 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:38.745588 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6264dd8e-a37d-4002-9b1c-b19113de9491 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:38.746063 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6264dd8e-a37d-4002-9b1c-b19113de9491 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:38.746672 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6264dd8e-a37d-4002-9b1c-b19113de9491 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:38.747573 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6264dd8e-a37d-4002-9b1c-b19113de9491 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:38.748175 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6264dd8e-a37d-4002-9b1c-b19113de9491 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:38.748752 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6264dd8e-a37d-4002-9b1c-b19113de9491 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:38.967511 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-6264dd8e-a37d-4002-9b1c-b19113de9491 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:38.975603 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-6264dd8e-a37d-4002-9b1c-b19113de9491 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1510 microversion: 2.1 time: 0.241931 Aug 24 07:42:38.976884 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 169/325] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:38 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1510 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:39.089677 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-9df770b1-d2f2-4a9f-b34a-d891f09c56ca tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:39.090841 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-9df770b1-d2f2-4a9f-b34a-d891f09c56ca tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 2e049e53-afdd-42e1-ad0c-4805c1579f14] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:39.097381 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9df770b1-d2f2-4a9f-b34a-d891f09c56ca tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:39.098215 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9df770b1-d2f2-4a9f-b34a-d891f09c56ca tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:39.098644 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9df770b1-d2f2-4a9f-b34a-d891f09c56ca tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:39.099559 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9df770b1-d2f2-4a9f-b34a-d891f09c56ca tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:39.100154 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9df770b1-d2f2-4a9f-b34a-d891f09c56ca tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:39.100801 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9df770b1-d2f2-4a9f-b34a-d891f09c56ca tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:39.521323 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-9df770b1-d2f2-4a9f-b34a-d891f09c56ca tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:39.533764 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-9df770b1-d2f2-4a9f-b34a-d891f09c56ca tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14" status: 200 len: 1314 microversion: 2.1 time: 0.448989 Aug 24 07:42:39.551662 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 157/326] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:39 2022] GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14 => generated 1314 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:42:39.998535 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-48974a8d-30d4-46e8-8899-2ce510b7a00a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:40.005242 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-48974a8d-30d4-46e8-8899-2ce510b7a00a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:40.012391 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-48974a8d-30d4-46e8-8899-2ce510b7a00a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:40.014235 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-48974a8d-30d4-46e8-8899-2ce510b7a00a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:40.017443 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-48974a8d-30d4-46e8-8899-2ce510b7a00a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:40.018531 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-48974a8d-30d4-46e8-8899-2ce510b7a00a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:40.022138 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-48974a8d-30d4-46e8-8899-2ce510b7a00a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:40.022890 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-48974a8d-30d4-46e8-8899-2ce510b7a00a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:40.284415 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-48974a8d-30d4-46e8-8899-2ce510b7a00a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:40.297023 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-48974a8d-30d4-46e8-8899-2ce510b7a00a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1516 microversion: 2.1 time: 0.302384 Aug 24 07:42:40.301496 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 170/327] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:39 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1516 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:40.561685 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-2033fffe-5075-4aea-a317-1ce41de8c573 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:40.562306 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-2033fffe-5075-4aea-a317-1ce41de8c573 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 2e049e53-afdd-42e1-ad0c-4805c1579f14] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:40.572901 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2033fffe-5075-4aea-a317-1ce41de8c573 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:40.573673 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2033fffe-5075-4aea-a317-1ce41de8c573 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:40.574589 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2033fffe-5075-4aea-a317-1ce41de8c573 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:40.575359 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2033fffe-5075-4aea-a317-1ce41de8c573 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:40.576149 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2033fffe-5075-4aea-a317-1ce41de8c573 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:40.576801 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2033fffe-5075-4aea-a317-1ce41de8c573 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:40.816218 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-2033fffe-5075-4aea-a317-1ce41de8c573 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:40.825081 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-2033fffe-5075-4aea-a317-1ce41de8c573 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14" status: 200 len: 1314 microversion: 2.1 time: 0.267321 Aug 24 07:42:40.825910 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 158/328] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:40 2022] GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14 => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:40.869651 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-1c26b20e-84b6-466b-b564-b37141dad940 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Action: 'create', calling method: .version_select at 0x7faf688bfb80>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2141614004", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGAK3Zsgn/oBvXqsikj1z6kAjwUVaEu5FlCNEIl71i4tXqhUFNJIdASWQJYG9u3nUudsDcMzz2URPTipJ+ocGzkFZZznyLFm/qJYPVnCf7hU6Bl8ozbt+TeONMrV44SOIw=="}} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:42:40.885312 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.quota [None req-1c26b20e-84b6-466b-b564-b37141dad940 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Getting quotas for project e97fd16d61ef4d5ebc5f435ae8a18561. Resources: {'key_pairs'} {{(pid=127114) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:42:40.889331 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.quota [None req-1c26b20e-84b6-466b-b564-b37141dad940 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Getting quotas for user 760115e8fb554582a016445f9aadc00c and project e97fd16d61ef4d5ebc5f435ae8a18561. Resources: {'key_pairs'} {{(pid=127114) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:42:40.913194 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-1c26b20e-84b6-466b-b564-b37141dad940 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.344976 Aug 24 07:42:40.913809 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 171/329] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Aug 24 07:42:40 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:42:41.846099 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-3bd1bdee-7e6d-41cd-81ec-46199a67d761 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:41.846893 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-3bd1bdee-7e6d-41cd-81ec-46199a67d761 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 2e049e53-afdd-42e1-ad0c-4805c1579f14] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:41.854465 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3bd1bdee-7e6d-41cd-81ec-46199a67d761 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:41.855408 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3bd1bdee-7e6d-41cd-81ec-46199a67d761 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:41.855975 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3bd1bdee-7e6d-41cd-81ec-46199a67d761 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:41.856941 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3bd1bdee-7e6d-41cd-81ec-46199a67d761 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:41.857657 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3bd1bdee-7e6d-41cd-81ec-46199a67d761 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:41.858614 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3bd1bdee-7e6d-41cd-81ec-46199a67d761 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:41.904138 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-39e98641-33d8-42d5-b1a1-7148b1dbc696 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Action: 'create', calling method: .version_select at 0x7faf686274c0>, body: {"keypair": {"name": "tempest-keypair-563726760", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7wyOgaIQ7KwrdCi6h9wLSDsFizYUSXGix5i7FuJ2nsG/QrSAMXxazS1w3a2XTv6K6kjsSwMnHPs+rpyQxXZQ02iZ0Qy8Eeuk8or9ghbkeyC/TtQlFQuv6oLFs6Dz6RDQ=="}} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:42:41.921130 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.quota [None req-39e98641-33d8-42d5-b1a1-7148b1dbc696 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Getting quotas for project d5672bdc355c4f63885138bd9c7f3497. Resources: {'key_pairs'} {{(pid=127114) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:42:41.925838 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.quota [None req-39e98641-33d8-42d5-b1a1-7148b1dbc696 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Getting quotas for user ea609a2504e64f6f9380061080976a6e and project d5672bdc355c4f63885138bd9c7f3497. Resources: {'key_pairs'} {{(pid=127114) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:42:41.954005 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-39e98641-33d8-42d5-b1a1-7148b1dbc696 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.053611 Aug 24 07:42:41.958856 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 172/330] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Aug 24 07:42:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:42:42.028112 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-3bd1bdee-7e6d-41cd-81ec-46199a67d761 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:42.037724 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-3bd1bdee-7e6d-41cd-81ec-46199a67d761 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14" status: 200 len: 1497 microversion: 2.1 time: 0.195652 Aug 24 07:42:42.038605 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 159/331] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:41 2022] GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14 => generated 1497 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:43.365000 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-82d4f0c4-d20a-42e9-aae9-a035b13820e9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1387617780", "imageRef": "4358f547-a499-43f3-9c84-925d78cd73db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "75bee617-1670-45bb-aad3-4cb896b99f45"}], "security_groups": [{"name": "tempest-securitygroup--1270852448"}], "key_name": "tempest-keypair-563726760", "user_data": "}} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:42:43.472681 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.network.neutron [None req-82d4f0c4-d20a-42e9-aae9-a035b13820e9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] validate_networks() for [('75bee617-1670-45bb-aad3-4cb896b99f45', None, None, None, None, None)] {{(pid=127114) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 07:42:43.877145 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-82d4f0c4-d20a-42e9-aae9-a035b13820e9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Flavor limits 0:0:0 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 07:42:43.877608 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-82d4f0c4-d20a-42e9-aae9-a035b13820e9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Image limits 0:0:0 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 07:42:43.878115 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-82d4f0c4-d20a-42e9-aae9-a035b13820e9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Flavor pref 0:0:0 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 07:42:43.878515 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-82d4f0c4-d20a-42e9-aae9-a035b13820e9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Image pref 0:0:0 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 07:42:43.879002 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-82d4f0c4-d20a-42e9-aae9-a035b13820e9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 07:42:43.889040 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-82d4f0c4-d20a-42e9-aae9-a035b13820e9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:43.889623 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-82d4f0c4-d20a-42e9-aae9-a035b13820e9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:43.890128 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-82d4f0c4-d20a-42e9-aae9-a035b13820e9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:43.890977 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-82d4f0c4-d20a-42e9-aae9-a035b13820e9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:43.891440 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-82d4f0c4-d20a-42e9-aae9-a035b13820e9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:43.891863 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-82d4f0c4-d20a-42e9-aae9-a035b13820e9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:43.914242 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.quota [None req-82d4f0c4-d20a-42e9-aae9-a035b13820e9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Getting quotas for project d5672bdc355c4f63885138bd9c7f3497. Resources: {'cores', 'ram', 'instances'} {{(pid=127114) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:42:43.918323 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.quota [None req-82d4f0c4-d20a-42e9-aae9-a035b13820e9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Getting quotas for user ea609a2504e64f6f9380061080976a6e and project d5672bdc355c4f63885138bd9c7f3497. Resources: {'cores', 'ram', 'instances'} {{(pid=127114) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:42:43.929544 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-82d4f0c4-d20a-42e9-aae9-a035b13820e9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Going to run 1 instances... {{(pid=127114) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 07:42:43.932166 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-82d4f0c4-d20a-42e9-aae9-a035b13820e9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4358f547-a499-43f3-9c84-925d78cd73db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127114) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 07:42:43.981279 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-82d4f0c4-d20a-42e9-aae9-a035b13820e9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.621790 Aug 24 07:42:43.981931 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 173/332] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 24 07:42:43 2022] POST /compute/v2.1/servers => generated 409 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 07:42:43.992727 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-33812388-bf5c-46dd-946a-d0ec5af52bf5 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:43.993265 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-33812388-bf5c-46dd-946a-d0ec5af52bf5 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:44.053127 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-33812388-bf5c-46dd-946a-d0ec5af52bf5 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:44.060698 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-33812388-bf5c-46dd-946a-d0ec5af52bf5 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de" status: 200 len: 1245 microversion: 2.1 time: 0.071850 Aug 24 07:42:44.061592 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 160/333] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:43 2022] GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de => generated 1245 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:45.082133 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-f7be082f-fd0b-4032-b393-e04d06d078fe tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:45.082644 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-f7be082f-fd0b-4032-b393-e04d06d078fe tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:45.088673 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f7be082f-fd0b-4032-b393-e04d06d078fe tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:45.089149 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f7be082f-fd0b-4032-b393-e04d06d078fe tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:45.089589 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f7be082f-fd0b-4032-b393-e04d06d078fe tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:45.090280 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f7be082f-fd0b-4032-b393-e04d06d078fe tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:45.090748 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f7be082f-fd0b-4032-b393-e04d06d078fe tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:45.091185 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f7be082f-fd0b-4032-b393-e04d06d078fe tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:45.168434 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-f7be082f-fd0b-4032-b393-e04d06d078fe tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:45.179767 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-f7be082f-fd0b-4032-b393-e04d06d078fe tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de" status: 200 len: 1297 microversion: 2.1 time: 0.101938 Aug 24 07:42:45.180510 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 174/334] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:45 2022] GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de => generated 1297 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:46.200549 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-35fea07d-f977-41a0-be1a-071f153c4e8d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:46.201108 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-35fea07d-f977-41a0-be1a-071f153c4e8d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:46.207517 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-35fea07d-f977-41a0-be1a-071f153c4e8d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:46.207995 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-35fea07d-f977-41a0-be1a-071f153c4e8d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:46.208424 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-35fea07d-f977-41a0-be1a-071f153c4e8d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:46.209102 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-35fea07d-f977-41a0-be1a-071f153c4e8d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:46.209553 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-35fea07d-f977-41a0-be1a-071f153c4e8d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:46.209972 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-35fea07d-f977-41a0-be1a-071f153c4e8d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:46.279825 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-35fea07d-f977-41a0-be1a-071f153c4e8d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:46.287954 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-35fea07d-f977-41a0-be1a-071f153c4e8d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de" status: 200 len: 1297 microversion: 2.1 time: 0.091475 Aug 24 07:42:46.288503 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 161/335] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:46 2022] GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de => generated 1297 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:47.308386 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-0eb9bc57-1075-43d2-9053-0b23032ce1cb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:47.309087 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-0eb9bc57-1075-43d2-9053-0b23032ce1cb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:47.311528 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=5 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:42:47.316726 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0eb9bc57-1075-43d2-9053-0b23032ce1cb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:47.317221 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0eb9bc57-1075-43d2-9053-0b23032ce1cb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:47.317662 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0eb9bc57-1075-43d2-9053-0b23032ce1cb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:47.318359 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0eb9bc57-1075-43d2-9053-0b23032ce1cb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:47.318847 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0eb9bc57-1075-43d2-9053-0b23032ce1cb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:47.319275 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0eb9bc57-1075-43d2-9053-0b23032ce1cb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:47.381174 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-0eb9bc57-1075-43d2-9053-0b23032ce1cb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:47.388792 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-0eb9bc57-1075-43d2-9053-0b23032ce1cb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de" status: 200 len: 1297 microversion: 2.1 time: 0.084607 Aug 24 07:42:47.389360 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 175/336] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:47 2022] GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de => generated 1297 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:48.408716 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-dbe2f0d8-2e18-4045-981b-a2d717343fd1 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:48.410196 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-dbe2f0d8-2e18-4045-981b-a2d717343fd1 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:48.416303 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-dbe2f0d8-2e18-4045-981b-a2d717343fd1 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:48.416778 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-dbe2f0d8-2e18-4045-981b-a2d717343fd1 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:48.417201 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-dbe2f0d8-2e18-4045-981b-a2d717343fd1 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:48.417982 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-dbe2f0d8-2e18-4045-981b-a2d717343fd1 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:48.418435 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-dbe2f0d8-2e18-4045-981b-a2d717343fd1 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:48.419011 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-dbe2f0d8-2e18-4045-981b-a2d717343fd1 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:48.489906 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-dbe2f0d8-2e18-4045-981b-a2d717343fd1 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:48.497912 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-dbe2f0d8-2e18-4045-981b-a2d717343fd1 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de" status: 200 len: 1303 microversion: 2.1 time: 0.093244 Aug 24 07:42:48.498562 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 162/337] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:48 2022] GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de => generated 1303 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:48.540371 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-312e49d1-acb1-4c76-ac8d-5be617ad1a8f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:48.541474 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-312e49d1-acb1-4c76-ac8d-5be617ad1a8f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 2e049e53-afdd-42e1-ad0c-4805c1579f14] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:48.548709 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-312e49d1-acb1-4c76-ac8d-5be617ad1a8f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:48.549413 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-312e49d1-acb1-4c76-ac8d-5be617ad1a8f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:48.549876 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-312e49d1-acb1-4c76-ac8d-5be617ad1a8f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:48.550922 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-312e49d1-acb1-4c76-ac8d-5be617ad1a8f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:48.551378 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-312e49d1-acb1-4c76-ac8d-5be617ad1a8f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:48.551800 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-312e49d1-acb1-4c76-ac8d-5be617ad1a8f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:48.578364 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-312e49d1-acb1-4c76-ac8d-5be617ad1a8f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 2e049e53-afdd-42e1-ad0c-4805c1579f14] Going to try to terminate instance {{(pid=127114) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 07:42:48.664507 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-312e49d1-acb1-4c76-ac8d-5be617ad1a8f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14" status: 204 len: 0 microversion: 2.1 time: 0.128088 Aug 24 07:42:48.665091 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 176/338] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 24 07:42:48 2022] DELETE /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 07:42:48.685242 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-1eda598e-97a3-4a9a-9b1d-adab53782edb tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:48.686264 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-1eda598e-97a3-4a9a-9b1d-adab53782edb tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 2e049e53-afdd-42e1-ad0c-4805c1579f14] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:48.694798 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1eda598e-97a3-4a9a-9b1d-adab53782edb tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:48.695379 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1eda598e-97a3-4a9a-9b1d-adab53782edb tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:48.695896 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1eda598e-97a3-4a9a-9b1d-adab53782edb tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:48.696966 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1eda598e-97a3-4a9a-9b1d-adab53782edb tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:48.697422 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1eda598e-97a3-4a9a-9b1d-adab53782edb tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:48.697841 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1eda598e-97a3-4a9a-9b1d-adab53782edb tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:49.033662 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-1eda598e-97a3-4a9a-9b1d-adab53782edb tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:49.037684 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell1:SELECT=100 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:42:49.043047 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-1eda598e-97a3-4a9a-9b1d-adab53782edb tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14" status: 200 len: 1503 microversion: 2.1 time: 0.373080 Aug 24 07:42:49.043618 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 163/339] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:48 2022] GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14 => generated 1503 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:49.520445 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-2496b593-571b-4eef-8b9e-37161c0b9137 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:49.521136 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-2496b593-571b-4eef-8b9e-37161c0b9137 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:49.527074 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2496b593-571b-4eef-8b9e-37161c0b9137 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:49.527502 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2496b593-571b-4eef-8b9e-37161c0b9137 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:49.527932 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2496b593-571b-4eef-8b9e-37161c0b9137 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:49.528612 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2496b593-571b-4eef-8b9e-37161c0b9137 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:49.529061 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2496b593-571b-4eef-8b9e-37161c0b9137 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:49.529485 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2496b593-571b-4eef-8b9e-37161c0b9137 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:49.659635 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-2496b593-571b-4eef-8b9e-37161c0b9137 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:49.667266 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-2496b593-571b-4eef-8b9e-37161c0b9137 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de" status: 200 len: 1371 microversion: 2.1 time: 0.151609 Aug 24 07:42:49.667826 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 177/340] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:49 2022] GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:50.064042 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-161f6c5b-5922-4617-bec9-2a5b45c9c114 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:50.064751 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-161f6c5b-5922-4617-bec9-2a5b45c9c114 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 2e049e53-afdd-42e1-ad0c-4805c1579f14] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:50.071823 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-161f6c5b-5922-4617-bec9-2a5b45c9c114 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:50.072372 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-161f6c5b-5922-4617-bec9-2a5b45c9c114 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:50.072902 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-161f6c5b-5922-4617-bec9-2a5b45c9c114 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:50.073675 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-161f6c5b-5922-4617-bec9-2a5b45c9c114 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:50.074198 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-161f6c5b-5922-4617-bec9-2a5b45c9c114 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:50.074634 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-161f6c5b-5922-4617-bec9-2a5b45c9c114 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:50.220634 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-161f6c5b-5922-4617-bec9-2a5b45c9c114 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:50.228527 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-161f6c5b-5922-4617-bec9-2a5b45c9c114 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14" status: 200 len: 1503 microversion: 2.1 time: 0.168322 Aug 24 07:42:50.229070 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 164/341] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:50 2022] GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14 => generated 1503 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:50.688120 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-1d3380e3-bedc-4b05-8e25-6fcfda437bea tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:50.688724 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-1d3380e3-bedc-4b05-8e25-6fcfda437bea tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:50.696924 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1d3380e3-bedc-4b05-8e25-6fcfda437bea tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:50.697400 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1d3380e3-bedc-4b05-8e25-6fcfda437bea tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:50.697833 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1d3380e3-bedc-4b05-8e25-6fcfda437bea tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:50.698517 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1d3380e3-bedc-4b05-8e25-6fcfda437bea tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:50.698995 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1d3380e3-bedc-4b05-8e25-6fcfda437bea tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:50.699419 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1d3380e3-bedc-4b05-8e25-6fcfda437bea tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:50.718317 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:42:50.828908 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-1d3380e3-bedc-4b05-8e25-6fcfda437bea tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:50.836892 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-1d3380e3-bedc-4b05-8e25-6fcfda437bea tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de" status: 200 len: 1371 microversion: 2.1 time: 0.152593 Aug 24 07:42:50.837448 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 178/342] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:50 2022] GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:51.249239 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-c4020074-2b52-4eb2-a142-758aaf0e7c7f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:51.249902 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-c4020074-2b52-4eb2-a142-758aaf0e7c7f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 2e049e53-afdd-42e1-ad0c-4805c1579f14] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:51.256549 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c4020074-2b52-4eb2-a142-758aaf0e7c7f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:51.257030 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c4020074-2b52-4eb2-a142-758aaf0e7c7f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:51.257492 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c4020074-2b52-4eb2-a142-758aaf0e7c7f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:51.258177 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c4020074-2b52-4eb2-a142-758aaf0e7c7f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:51.258629 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c4020074-2b52-4eb2-a142-758aaf0e7c7f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:51.259077 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c4020074-2b52-4eb2-a142-758aaf0e7c7f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:51.387066 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-c4020074-2b52-4eb2-a142-758aaf0e7c7f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:51.394597 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-c4020074-2b52-4eb2-a142-758aaf0e7c7f tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14" status: 200 len: 1503 microversion: 2.1 time: 0.149300 Aug 24 07:42:51.395189 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 165/343] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:51 2022] GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14 => generated 1503 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:51.858050 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-de89bc1e-f66e-4325-a07b-18de7fa52642 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:51.858659 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-de89bc1e-f66e-4325-a07b-18de7fa52642 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:51.865128 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-de89bc1e-f66e-4325-a07b-18de7fa52642 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:51.865612 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-de89bc1e-f66e-4325-a07b-18de7fa52642 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:51.866046 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-de89bc1e-f66e-4325-a07b-18de7fa52642 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:51.866764 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-de89bc1e-f66e-4325-a07b-18de7fa52642 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:51.867224 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-de89bc1e-f66e-4325-a07b-18de7fa52642 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:51.867649 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-de89bc1e-f66e-4325-a07b-18de7fa52642 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:52.006799 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-de89bc1e-f66e-4325-a07b-18de7fa52642 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:52.015139 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-de89bc1e-f66e-4325-a07b-18de7fa52642 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de" status: 200 len: 1371 microversion: 2.1 time: 0.160792 Aug 24 07:42:52.015727 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 179/344] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:51 2022] GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:52.415913 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-8bf91f8d-c56f-44ad-9a24-41ea2dc41137 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:52.416498 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-8bf91f8d-c56f-44ad-9a24-41ea2dc41137 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 2e049e53-afdd-42e1-ad0c-4805c1579f14] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:52.422380 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8bf91f8d-c56f-44ad-9a24-41ea2dc41137 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:52.422896 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8bf91f8d-c56f-44ad-9a24-41ea2dc41137 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:52.423325 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8bf91f8d-c56f-44ad-9a24-41ea2dc41137 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:52.424006 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8bf91f8d-c56f-44ad-9a24-41ea2dc41137 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:52.424452 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8bf91f8d-c56f-44ad-9a24-41ea2dc41137 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:52.425494 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8bf91f8d-c56f-44ad-9a24-41ea2dc41137 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:52.549491 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-8bf91f8d-c56f-44ad-9a24-41ea2dc41137 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:52.557990 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-8bf91f8d-c56f-44ad-9a24-41ea2dc41137 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14" status: 200 len: 1503 microversion: 2.1 time: 0.145868 Aug 24 07:42:52.558551 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 166/345] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:52 2022] GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14 => generated 1503 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:53.036171 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-cf7cc90b-b661-4f8e-ace7-f4e006c55255 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:53.036894 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-cf7cc90b-b661-4f8e-ace7-f4e006c55255 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:53.043675 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cf7cc90b-b661-4f8e-ace7-f4e006c55255 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:53.045096 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cf7cc90b-b661-4f8e-ace7-f4e006c55255 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:53.045703 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cf7cc90b-b661-4f8e-ace7-f4e006c55255 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:53.046404 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cf7cc90b-b661-4f8e-ace7-f4e006c55255 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:53.049151 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cf7cc90b-b661-4f8e-ace7-f4e006c55255 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:53.050027 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cf7cc90b-b661-4f8e-ace7-f4e006c55255 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:53.318491 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-cf7cc90b-b661-4f8e-ace7-f4e006c55255 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:53.346825 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-cf7cc90b-b661-4f8e-ace7-f4e006c55255 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de" status: 200 len: 1371 microversion: 2.1 time: 0.306261 Aug 24 07:42:53.349687 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 180/346] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:53 2022] GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de => generated 1371 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:53.545548 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [req-6216bbc9-32cb-49ee-aab7-1485bbf5cb31 req-54b80d41-a169-42a8-8700-50b9cda58915 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "177a69e5-5a8e-48a8-99a8-928790a6a4de", "tag": "4c3c99fa-7ec3-487c-bf8f-3f7c8ee8b4ff"}]} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:42:53.563101 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-6216bbc9-32cb-49ee-aab7-1485bbf5cb31 req-54b80d41-a169-42a8-8700-50b9cda58915 service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:53.563825 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-6216bbc9-32cb-49ee-aab7-1485bbf5cb31 req-54b80d41-a169-42a8-8700-50b9cda58915 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:53.564577 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-6216bbc9-32cb-49ee-aab7-1485bbf5cb31 req-54b80d41-a169-42a8-8700-50b9cda58915 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:53.579602 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-8dd391fc-e518-47ea-a4aa-bdc41e61c0d5 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:53.580338 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-8dd391fc-e518-47ea-a4aa-bdc41e61c0d5 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 2e049e53-afdd-42e1-ad0c-4805c1579f14] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:53.592267 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.compute.server_external_events [req-6216bbc9-32cb-49ee-aab7-1485bbf5cb31 req-54b80d41-a169-42a8-8700-50b9cda58915 service nova] Creating event network-changed:4c3c99fa-7ec3-487c-bf8f-3f7c8ee8b4ff for instance 177a69e5-5a8e-48a8-99a8-928790a6a4de on hv-cinder-85427 Aug 24 07:42:53.598374 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [req-6216bbc9-32cb-49ee-aab7-1485bbf5cb31 req-54b80d41-a169-42a8-8700-50b9cda58915 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058872 Aug 24 07:42:53.599289 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8dd391fc-e518-47ea-a4aa-bdc41e61c0d5 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:53.599629 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 167/347] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:42:53.600309 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8dd391fc-e518-47ea-a4aa-bdc41e61c0d5 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:53.600755 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8dd391fc-e518-47ea-a4aa-bdc41e61c0d5 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:53.603789 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8dd391fc-e518-47ea-a4aa-bdc41e61c0d5 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:53.604366 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8dd391fc-e518-47ea-a4aa-bdc41e61c0d5 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:53.604871 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8dd391fc-e518-47ea-a4aa-bdc41e61c0d5 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:53.703920 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [req-d33749bf-8293-4152-803c-4a6bf22fb4d4 req-b38213e0-3181-45d7-bdbd-68571a016b03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e049e53-afdd-42e1-ad0c-4805c1579f14", "name": "network-vif-deleted", "tag": "9dfd157f-ec13-4a0a-ba1c-2ff8ed089c8a"}]} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:42:53.713676 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-d33749bf-8293-4152-803c-4a6bf22fb4d4 req-b38213e0-3181-45d7-bdbd-68571a016b03 service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:53.714153 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-d33749bf-8293-4152-803c-4a6bf22fb4d4 req-b38213e0-3181-45d7-bdbd-68571a016b03 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:53.714576 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-d33749bf-8293-4152-803c-4a6bf22fb4d4 req-b38213e0-3181-45d7-bdbd-68571a016b03 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:53.722020 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-8dd391fc-e518-47ea-a4aa-bdc41e61c0d5 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:53.730199 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-8dd391fc-e518-47ea-a4aa-bdc41e61c0d5 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14" status: 200 len: 1461 microversion: 2.1 time: 0.155382 Aug 24 07:42:53.733097 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.compute.server_external_events [req-d33749bf-8293-4152-803c-4a6bf22fb4d4 req-b38213e0-3181-45d7-bdbd-68571a016b03 service nova] Creating event network-vif-deleted:9dfd157f-ec13-4a0a-ba1c-2ff8ed089c8a for instance 2e049e53-afdd-42e1-ad0c-4805c1579f14 on hv-cinder-85427 Aug 24 07:42:53.740747 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [req-d33749bf-8293-4152-803c-4a6bf22fb4d4 req-b38213e0-3181-45d7-bdbd-68571a016b03 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040668 Aug 24 07:42:53.742286 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 168/348] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:42:53.747299 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 181/349] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:53 2022] GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14 => generated 1461 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:42:54.369192 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-4d031eba-7233-42ae-b2c2-6a3e51f0a052 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:54.369819 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-4d031eba-7233-42ae-b2c2-6a3e51f0a052 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:54.371822 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell0:SELECT=2 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:42:54.378372 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4d031eba-7233-42ae-b2c2-6a3e51f0a052 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:54.378828 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4d031eba-7233-42ae-b2c2-6a3e51f0a052 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:54.379546 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4d031eba-7233-42ae-b2c2-6a3e51f0a052 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:54.380456 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4d031eba-7233-42ae-b2c2-6a3e51f0a052 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:54.380953 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4d031eba-7233-42ae-b2c2-6a3e51f0a052 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:54.381509 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4d031eba-7233-42ae-b2c2-6a3e51f0a052 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:54.509117 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-4d031eba-7233-42ae-b2c2-6a3e51f0a052 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:54.516598 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-4d031eba-7233-42ae-b2c2-6a3e51f0a052 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de" status: 200 len: 1371 microversion: 2.1 time: 0.151739 Aug 24 07:42:54.517137 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 169/350] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:54 2022] GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:42:54.751658 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-a7d99238-6fd8-4a81-9950-f5224a3a471c tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:54.752351 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-a7d99238-6fd8-4a81-9950-f5224a3a471c tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 2e049e53-afdd-42e1-ad0c-4805c1579f14] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:54.755351 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell0:SELECT=2 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:42:54.756190 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell0:SELECT=14 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:42:54.760191 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a7d99238-6fd8-4a81-9950-f5224a3a471c tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:54.760833 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a7d99238-6fd8-4a81-9950-f5224a3a471c tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:54.761279 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a7d99238-6fd8-4a81-9950-f5224a3a471c tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:54.761974 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a7d99238-6fd8-4a81-9950-f5224a3a471c tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:54.762431 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a7d99238-6fd8-4a81-9950-f5224a3a471c tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:54.762888 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a7d99238-6fd8-4a81-9950-f5224a3a471c tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:54.796123 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a7d99238-6fd8-4a81-9950-f5224a3a471c tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:54.796600 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a7d99238-6fd8-4a81-9950-f5224a3a471c tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:54.797048 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a7d99238-6fd8-4a81-9950-f5224a3a471c tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:54.797488 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.objects.instance [None req-a7d99238-6fd8-4a81-9950-f5224a3a471c tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lazy-loading 'fault' on Instance uuid 2e049e53-afdd-42e1-ad0c-4805c1579f14 {{(pid=127114) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:42:54.837689 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-a7d99238-6fd8-4a81-9950-f5224a3a471c tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:54.845059 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-a7d99238-6fd8-4a81-9950-f5224a3a471c tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14" status: 200 len: 1304 microversion: 2.1 time: 0.097156 Aug 24 07:42:54.845615 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 182/351] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:54 2022] GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14 => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:55.538998 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-218d40fc-313f-464d-8077-132f86af9be8 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:55.539603 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-218d40fc-313f-464d-8077-132f86af9be8 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:55.545617 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-218d40fc-313f-464d-8077-132f86af9be8 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:55.546089 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-218d40fc-313f-464d-8077-132f86af9be8 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:55.546517 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-218d40fc-313f-464d-8077-132f86af9be8 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:55.547231 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-218d40fc-313f-464d-8077-132f86af9be8 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:55.547676 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-218d40fc-313f-464d-8077-132f86af9be8 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:55.548092 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-218d40fc-313f-464d-8077-132f86af9be8 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:55.678535 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-218d40fc-313f-464d-8077-132f86af9be8 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:55.686237 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-218d40fc-313f-464d-8077-132f86af9be8 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de" status: 200 len: 1371 microversion: 2.1 time: 0.151801 Aug 24 07:42:55.686798 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 170/352] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:55 2022] GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:55.866679 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-4b98b8ae-61e7-4720-a9d3-3244694c8fb3 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:55.867285 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-4b98b8ae-61e7-4720-a9d3-3244694c8fb3 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 2e049e53-afdd-42e1-ad0c-4805c1579f14] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:55.873641 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4b98b8ae-61e7-4720-a9d3-3244694c8fb3 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:55.874115 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4b98b8ae-61e7-4720-a9d3-3244694c8fb3 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:55.874542 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4b98b8ae-61e7-4720-a9d3-3244694c8fb3 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:55.875247 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4b98b8ae-61e7-4720-a9d3-3244694c8fb3 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:55.875697 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4b98b8ae-61e7-4720-a9d3-3244694c8fb3 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:55.876114 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4b98b8ae-61e7-4720-a9d3-3244694c8fb3 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:55.914108 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4b98b8ae-61e7-4720-a9d3-3244694c8fb3 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:55.914585 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4b98b8ae-61e7-4720-a9d3-3244694c8fb3 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:55.915114 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4b98b8ae-61e7-4720-a9d3-3244694c8fb3 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:55.915556 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.objects.instance [None req-4b98b8ae-61e7-4720-a9d3-3244694c8fb3 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lazy-loading 'fault' on Instance uuid 2e049e53-afdd-42e1-ad0c-4805c1579f14 {{(pid=127114) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:42:55.955365 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-4b98b8ae-61e7-4720-a9d3-3244694c8fb3 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:55.963599 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-4b98b8ae-61e7-4720-a9d3-3244694c8fb3 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14" status: 200 len: 1304 microversion: 2.1 time: 0.100704 Aug 24 07:42:55.964156 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 183/353] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:55 2022] GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14 => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:56.706985 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-b54db6cf-0653-4df7-93a3-db2ff042ddcb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:56.707572 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-b54db6cf-0653-4df7-93a3-db2ff042ddcb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:56.713376 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b54db6cf-0653-4df7-93a3-db2ff042ddcb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:56.713844 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b54db6cf-0653-4df7-93a3-db2ff042ddcb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:56.714276 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b54db6cf-0653-4df7-93a3-db2ff042ddcb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:56.714967 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b54db6cf-0653-4df7-93a3-db2ff042ddcb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:56.715410 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b54db6cf-0653-4df7-93a3-db2ff042ddcb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:56.715822 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b54db6cf-0653-4df7-93a3-db2ff042ddcb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:56.851551 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-b54db6cf-0653-4df7-93a3-db2ff042ddcb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:56.858887 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-b54db6cf-0653-4df7-93a3-db2ff042ddcb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de" status: 200 len: 1371 microversion: 2.1 time: 0.156221 Aug 24 07:42:56.859437 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 171/354] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:56 2022] GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:56.985404 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-f785b313-c191-4884-8b9b-ceb85af5b8fc tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:56.987903 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-f785b313-c191-4884-8b9b-ceb85af5b8fc tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 2e049e53-afdd-42e1-ad0c-4805c1579f14] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:56.994830 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f785b313-c191-4884-8b9b-ceb85af5b8fc tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:56.995310 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f785b313-c191-4884-8b9b-ceb85af5b8fc tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:56.995735 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f785b313-c191-4884-8b9b-ceb85af5b8fc tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:56.997800 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f785b313-c191-4884-8b9b-ceb85af5b8fc tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:56.998264 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f785b313-c191-4884-8b9b-ceb85af5b8fc tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:56.998684 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f785b313-c191-4884-8b9b-ceb85af5b8fc tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:57.033531 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f785b313-c191-4884-8b9b-ceb85af5b8fc tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:57.034010 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f785b313-c191-4884-8b9b-ceb85af5b8fc tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:57.034965 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f785b313-c191-4884-8b9b-ceb85af5b8fc tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:57.034965 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.objects.instance [None req-f785b313-c191-4884-8b9b-ceb85af5b8fc tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lazy-loading 'fault' on Instance uuid 2e049e53-afdd-42e1-ad0c-4805c1579f14 {{(pid=127114) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:42:57.091371 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-f785b313-c191-4884-8b9b-ceb85af5b8fc tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7f3a776c48e4cebb7624d215f93cd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f10902cae64a09b587e9a481ce9e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:57.099381 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-f785b313-c191-4884-8b9b-ceb85af5b8fc tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14" status: 200 len: 1304 microversion: 2.1 time: 0.117866 Aug 24 07:42:57.100355 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 184/355] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:56 2022] GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14 => generated 1304 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:42:57.870707 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-be867307-4002-4550-a98e-864bd176da62 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:57.871222 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-be867307-4002-4550-a98e-864bd176da62 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: d596e142-eb18-49d4-8eb8-bec422282059] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:57.877062 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-be867307-4002-4550-a98e-864bd176da62 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:57.877533 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-be867307-4002-4550-a98e-864bd176da62 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:57.877985 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-be867307-4002-4550-a98e-864bd176da62 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:57.878581 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-1e76e180-853e-4b44-9611-b501eeda20e8 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:57.879182 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-be867307-4002-4550-a98e-864bd176da62 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:57.879542 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-1e76e180-853e-4b44-9611-b501eeda20e8 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:57.879655 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-be867307-4002-4550-a98e-864bd176da62 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:57.880063 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-be867307-4002-4550-a98e-864bd176da62 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:57.886591 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1e76e180-853e-4b44-9611-b501eeda20e8 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:57.887166 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1e76e180-853e-4b44-9611-b501eeda20e8 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:57.887675 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1e76e180-853e-4b44-9611-b501eeda20e8 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:57.888472 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1e76e180-853e-4b44-9611-b501eeda20e8 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:57.889054 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1e76e180-853e-4b44-9611-b501eeda20e8 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:57.889531 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1e76e180-853e-4b44-9611-b501eeda20e8 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:57.911311 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-be867307-4002-4550-a98e-864bd176da62 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/d596e142-eb18-49d4-8eb8-bec422282059/ips" status: 200 len: 149 microversion: 2.1 time: 0.043974 Aug 24 07:42:57.912347 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 172/356] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Aug 24 07:42:57 2022] GET /compute/v2.1/servers/d596e142-eb18-49d4-8eb8-bec422282059/ips => generated 149 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:42:58.040768 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-1e76e180-853e-4b44-9611-b501eeda20e8 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:58.057851 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-1e76e180-853e-4b44-9611-b501eeda20e8 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de" status: 200 len: 1371 microversion: 2.1 time: 0.183213 Aug 24 07:42:58.061970 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 185/357] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:57 2022] GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de => generated 1371 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:42:58.120268 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-b01b9604-402a-4a45-b1f3-1f0f6412de49 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:58.120873 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-b01b9604-402a-4a45-b1f3-1f0f6412de49 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] [instance: 2e049e53-afdd-42e1-ad0c-4805c1579f14] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:58.127144 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b01b9604-402a-4a45-b1f3-1f0f6412de49 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:58.127372 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b01b9604-402a-4a45-b1f3-1f0f6412de49 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:58.127933 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b01b9604-402a-4a45-b1f3-1f0f6412de49 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:58.128653 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b01b9604-402a-4a45-b1f3-1f0f6412de49 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:58.129496 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b01b9604-402a-4a45-b1f3-1f0f6412de49 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:58.129916 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b01b9604-402a-4a45-b1f3-1f0f6412de49 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:58.144862 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.wsgi [None req-b01b9604-402a-4a45-b1f3-1f0f6412de49 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] HTTP exception thrown: Instance 2e049e53-afdd-42e1-ad0c-4805c1579f14 could not be found. Aug 24 07:42:58.146530 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-b01b9604-402a-4a45-b1f3-1f0f6412de49 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Request method failure captured: Aug 24 07:42:58.146530 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: request: GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14 HTTP/1.1 Aug 24 07:42:58.146530 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept: application/json Aug 24 07:42:58.146530 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept-Encoding: identity Aug 24 07:42:58.146530 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Connection: close Aug 24 07:42:58.146530 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Length: 0 Aug 24 07:42:58.146530 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Type: application/json Aug 24 07:42:58.146530 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Host: 10.222.0.42 Aug 24 07:42:58.146530 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Openstack-System-Scope: None Aug 24 07:42:58.146530 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: User-Agent: python-urllib3/1.26.11 Aug 24 07:42:58.146530 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Auth-Token: gAAAAABjBdYtfg37b_yRauNCMNCISCe0CYmpmYHpxzBTBwVj_tLHcB9Bc2EtvkBGNSDrt_0IpkQc57c0rFGAUf2TQNIlVj9L8UQT8cTQepJVWPxjR04Jy3BIkBI4MDMnqXaJTkhbQqi2dSfM0X6Akr6XjIrRL2_I_6ssAqn-pNym1UO54AHNoU8 Aug 24 07:42:58.146530 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Id: None Aug 24 07:42:58.146530 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Name: None Aug 24 07:42:58.146530 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Identity-Status: Confirmed Aug 24 07:42:58.146530 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Is-Admin-Project: True Aug 24 07:42:58.146530 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Id: default Aug 24 07:42:58.146530 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Name: Default Aug 24 07:42:58.146530 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Id: 71f10902cae64a09b587e9a481ce9e41 Aug 24 07:42:58.146530 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Name: tempest-VolumesActionsTest-981695490 Aug 24 07:42:58.146530 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Role: reader,member Aug 24 07:42:58.146530 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Roles: reader,member Aug 24 07:42:58.148131 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/71f10902cae64a09b587e9a481ce9e41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_71f10902cae64a09b587e9a481ce9e41", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/71f10902cae64a09b587e9a481ce9e41"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/71f10902cae64a09b587e9a481ce9e41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:42:58.148131 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant: tempest-VolumesActionsTest-981695490 Aug 24 07:42:58.148131 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Id: 71f10902cae64a09b587e9a481ce9e41 Aug 24 07:42:58.148131 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Name: tempest-VolumesActionsTest-981695490 Aug 24 07:42:58.148131 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User: tempest-VolumesActionsTest-981695490-project Aug 24 07:42:58.148131 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Id: default Aug 24 07:42:58.148131 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Name: Default Aug 24 07:42:58.148131 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Id: c7f3a776c48e4cebb7624d215f93cd1a Aug 24 07:42:58.148131 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Name: tempest-VolumesActionsTest-981695490-project Aug 24 07:42:58.148131 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: method: > Aug 24 07:42:58.148131 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: exception: Instance 2e049e53-afdd-42e1-ad0c-4805c1579f14 could not be found. Aug 24 07:42:58.148131 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: action_args: {'id': '2e049e53-afdd-42e1-ad0c-4805c1579f14'} Aug 24 07:42:58.148975 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:42:58.148975 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:42:58.148975 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:42:58.148975 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:42:58.148975 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:42:58.148975 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:42:58.148975 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:42:58.148975 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:42:58.148975 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:42:58.148975 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:42:58.148975 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e049e53-afdd-42e1-ad0c-4805c1579f14 could not be found. Aug 24 07:42:58.148975 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:42:58.148975 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:42:58.148975 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:42:58.148975 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:42:58.148975 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:42:58.148975 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:42:58.148975 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:42:58.148975 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:42:58.148975 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:42:58.150621 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:42:58.150621 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 07:42:58.150621 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 07:42:58.150621 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:42:58.150621 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:42:58.150621 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:42:58.150621 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:42:58.150621 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e049e53-afdd-42e1-ad0c-4805c1579f14 could not be found. Aug 24 07:42:58.150621 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:42:58.150621 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:42:58.150621 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:42:58.150621 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:42:58.150621 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:42:58.150621 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:42:58.150621 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:42:58.150621 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:42:58.150621 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e049e53-afdd-42e1-ad0c-4805c1579f14 could not be found. Aug 24 07:42:58.150621 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:42:58.153014 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-b01b9604-402a-4a45-b1f3-1f0f6412de49 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] Returning 404 to user: Instance 2e049e53-afdd-42e1-ad0c-4805c1579f14 could not be found. {{(pid=127113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:42:58.153014 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-b01b9604-402a-4a45-b1f3-1f0f6412de49 tempest-VolumesActionsTest-981695490 tempest-VolumesActionsTest-981695490-project] 10.222.0.42 "GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14" status: 404 len: 111 microversion: 2.1 time: 0.032085 Aug 24 07:42:58.154419 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 173/358] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:58 2022] GET /compute/v2.1/servers/2e049e53-afdd-42e1-ad0c-4805c1579f14 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:42:59.085338 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-c6a8f4b9-5eb7-4eaa-a546-cfec2b3907f6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:42:59.088799 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-c6a8f4b9-5eb7-4eaa-a546-cfec2b3907f6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:59.095449 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c6a8f4b9-5eb7-4eaa-a546-cfec2b3907f6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:59.095932 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c6a8f4b9-5eb7-4eaa-a546-cfec2b3907f6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:59.096354 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c6a8f4b9-5eb7-4eaa-a546-cfec2b3907f6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:59.097097 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c6a8f4b9-5eb7-4eaa-a546-cfec2b3907f6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:59.097598 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c6a8f4b9-5eb7-4eaa-a546-cfec2b3907f6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:59.098043 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c6a8f4b9-5eb7-4eaa-a546-cfec2b3907f6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:59.235733 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-c6a8f4b9-5eb7-4eaa-a546-cfec2b3907f6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:42:59.244008 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-c6a8f4b9-5eb7-4eaa-a546-cfec2b3907f6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de" status: 200 len: 1371 microversion: 2.1 time: 0.162957 Aug 24 07:42:59.244659 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 186/359] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:42:59 2022] GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:42:59.357998 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-94ca5b26-b2aa-4067-a30f-53264a150286 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a4fcf7f-d359-41bd-a444-1c1efc4cd791"}} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:42:59.362391 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-94ca5b26-b2aa-4067-a30f-53264a150286 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: d596e142-eb18-49d4-8eb8-bec422282059] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:42:59.369126 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-94ca5b26-b2aa-4067-a30f-53264a150286 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:59.369598 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-94ca5b26-b2aa-4067-a30f-53264a150286 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:59.370020 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-94ca5b26-b2aa-4067-a30f-53264a150286 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:42:59.370725 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-94ca5b26-b2aa-4067-a30f-53264a150286 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:42:59.371192 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-94ca5b26-b2aa-4067-a30f-53264a150286 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:42:59.371604 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-94ca5b26-b2aa-4067-a30f-53264a150286 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:00.264633 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-356a2aaf-e89c-4600-b42f-a433f6446f60 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:00.265229 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-356a2aaf-e89c-4600-b42f-a433f6446f60 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:00.271614 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-356a2aaf-e89c-4600-b42f-a433f6446f60 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:00.272084 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-356a2aaf-e89c-4600-b42f-a433f6446f60 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:00.272506 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-356a2aaf-e89c-4600-b42f-a433f6446f60 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:00.273184 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-356a2aaf-e89c-4600-b42f-a433f6446f60 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:00.273624 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-356a2aaf-e89c-4600-b42f-a433f6446f60 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:00.274039 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-356a2aaf-e89c-4600-b42f-a433f6446f60 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:00.397580 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-356a2aaf-e89c-4600-b42f-a433f6446f60 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:00.405086 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-356a2aaf-e89c-4600-b42f-a433f6446f60 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de" status: 200 len: 1371 microversion: 2.1 time: 0.144369 Aug 24 07:43:00.405646 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 187/360] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:00 2022] GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de => generated 1371 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:43:01.425219 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-9a169ccb-d408-4af7-b77f-3fc70cc957c2 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:01.425980 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-9a169ccb-d408-4af7-b77f-3fc70cc957c2 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:01.433648 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9a169ccb-d408-4af7-b77f-3fc70cc957c2 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:01.434293 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9a169ccb-d408-4af7-b77f-3fc70cc957c2 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:01.434890 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9a169ccb-d408-4af7-b77f-3fc70cc957c2 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:01.435803 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9a169ccb-d408-4af7-b77f-3fc70cc957c2 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:01.436323 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9a169ccb-d408-4af7-b77f-3fc70cc957c2 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:01.436749 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9a169ccb-d408-4af7-b77f-3fc70cc957c2 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:01.571346 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-9a169ccb-d408-4af7-b77f-3fc70cc957c2 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:01.582231 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-9a169ccb-d408-4af7-b77f-3fc70cc957c2 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de" status: 200 len: 1371 microversion: 2.1 time: 0.157821 Aug 24 07:43:01.582844 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 188/361] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:01 2022] GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:43:02.515420 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-94ca5b26-b2aa-4067-a30f-53264a150286 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "POST /compute/v2.1/servers/d596e142-eb18-49d4-8eb8-bec422282059/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.161076 Aug 24 07:43:02.516200 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 174/362] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Aug 24 07:42:59 2022] POST /compute/v2.1/servers/d596e142-eb18-49d4-8eb8-bec422282059/os-volume_attachments => generated 194 bytes in 3163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:43:02.603414 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-f7096a44-92fc-423f-acb1-44ad1da1ef7a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:02.604002 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-f7096a44-92fc-423f-acb1-44ad1da1ef7a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:02.610784 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f7096a44-92fc-423f-acb1-44ad1da1ef7a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:02.611114 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f7096a44-92fc-423f-acb1-44ad1da1ef7a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:02.611547 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f7096a44-92fc-423f-acb1-44ad1da1ef7a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:02.612237 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f7096a44-92fc-423f-acb1-44ad1da1ef7a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:02.612721 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f7096a44-92fc-423f-acb1-44ad1da1ef7a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:02.613173 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f7096a44-92fc-423f-acb1-44ad1da1ef7a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:02.756002 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-f7096a44-92fc-423f-acb1-44ad1da1ef7a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:02.763576 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-f7096a44-92fc-423f-acb1-44ad1da1ef7a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de" status: 200 len: 1371 microversion: 2.1 time: 0.164037 Aug 24 07:43:02.764137 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 189/363] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:02 2022] GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:03.096578 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-98fa330c-62e8-4889-ab11-efd457d8fc59 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:03.097160 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-98fa330c-62e8-4889-ab11-efd457d8fc59 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] [instance: 7a4bf12e-c36e-425e-bd1f-181bd4326de3] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:03.099046 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_api:SELECT=48 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:03.104503 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-98fa330c-62e8-4889-ab11-efd457d8fc59 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:03.104976 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-98fa330c-62e8-4889-ab11-efd457d8fc59 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:03.105406 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-98fa330c-62e8-4889-ab11-efd457d8fc59 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:03.106084 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-98fa330c-62e8-4889-ab11-efd457d8fc59 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:03.106529 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-98fa330c-62e8-4889-ab11-efd457d8fc59 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:03.106975 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-98fa330c-62e8-4889-ab11-efd457d8fc59 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:03.230924 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.objects.instance [None req-98fa330c-62e8-4889-ab11-efd457d8fc59 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lazy-loading 'services' on Instance uuid 7a4bf12e-c36e-425e-bd1f-181bd4326de3 {{(pid=127113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:43:03.343686 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-98fa330c-62e8-4889-ab11-efd457d8fc59 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7a4bf12e-c36e-425e-bd1f-181bd4326de3/os-volume_attachments/b085ad56-9158-45e9-9a22-ce98fda99902" status: 202 len: 0 microversion: 2.1 time: 0.251559 Aug 24 07:43:03.344254 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 175/364] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Aug 24 07:43:03 2022] DELETE /compute/v2.1/servers/7a4bf12e-c36e-425e-bd1f-181bd4326de3/os-volume_attachments/b085ad56-9158-45e9-9a22-ce98fda99902 => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 07:43:03.785664 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-327aff54-4531-4afc-9fd4-5a364f6203de tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:03.786428 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-327aff54-4531-4afc-9fd4-5a364f6203de tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:03.790375 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [req-bfc73885-208b-4bae-86ce-93d1a367e115 req-0b36ad51-df0b-41ea-8c65-957a644fa85a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "177a69e5-5a8e-48a8-99a8-928790a6a4de", "name": "network-vif-plugged", "status": "completed", "tag": "4c3c99fa-7ec3-487c-bf8f-3f7c8ee8b4ff"}]} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:43:03.794801 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-327aff54-4531-4afc-9fd4-5a364f6203de tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:03.795334 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-327aff54-4531-4afc-9fd4-5a364f6203de tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:03.795762 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-327aff54-4531-4afc-9fd4-5a364f6203de tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:03.796792 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-327aff54-4531-4afc-9fd4-5a364f6203de tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:03.797220 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-327aff54-4531-4afc-9fd4-5a364f6203de tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:03.797804 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-327aff54-4531-4afc-9fd4-5a364f6203de tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:03.804122 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-bfc73885-208b-4bae-86ce-93d1a367e115 req-0b36ad51-df0b-41ea-8c65-957a644fa85a service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:03.804601 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-bfc73885-208b-4bae-86ce-93d1a367e115 req-0b36ad51-df0b-41ea-8c65-957a644fa85a service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:03.805017 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-bfc73885-208b-4bae-86ce-93d1a367e115 req-0b36ad51-df0b-41ea-8c65-957a644fa85a service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:03.818231 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.compute.server_external_events [req-bfc73885-208b-4bae-86ce-93d1a367e115 req-0b36ad51-df0b-41ea-8c65-957a644fa85a service nova] Creating event network-vif-plugged:4c3c99fa-7ec3-487c-bf8f-3f7c8ee8b4ff for instance 177a69e5-5a8e-48a8-99a8-928790a6a4de on hv-cinder-85427 Aug 24 07:43:03.824137 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [req-bfc73885-208b-4bae-86ce-93d1a367e115 req-0b36ad51-df0b-41ea-8c65-957a644fa85a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039032 Aug 24 07:43:03.824933 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 176/365] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:43:03.975828 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-327aff54-4531-4afc-9fd4-5a364f6203de tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:03.984152 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-327aff54-4531-4afc-9fd4-5a364f6203de tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de" status: 200 len: 1371 microversion: 2.1 time: 0.203156 Aug 24 07:43:03.985031 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 190/366] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:03 2022] GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de => generated 1371 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:04.295052 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-c14ff0e4-42ff-48c1-a033-4ddcc20b54cf tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-466051287", "imageRef": "4358f547-a499-43f3-9c84-925d78cd73db", "flavorRef": "452"}} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:43:04.350503 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.network.neutron [None req-c14ff0e4-42ff-48c1-a033-4ddcc20b54cf tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] validate_networks() for None {{(pid=127113) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 07:43:04.645788 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.virt.hardware [None req-c14ff0e4-42ff-48c1-a033-4ddcc20b54cf tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Flavor limits 0:0:0 {{(pid=127113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 07:43:04.646212 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.virt.hardware [None req-c14ff0e4-42ff-48c1-a033-4ddcc20b54cf tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Image limits 0:0:0 {{(pid=127113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 07:43:04.646704 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.virt.hardware [None req-c14ff0e4-42ff-48c1-a033-4ddcc20b54cf tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Flavor pref 0:0:0 {{(pid=127113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 07:43:04.647122 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.virt.hardware [None req-c14ff0e4-42ff-48c1-a033-4ddcc20b54cf tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Image pref 0:0:0 {{(pid=127113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 07:43:04.648028 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.virt.hardware [None req-c14ff0e4-42ff-48c1-a033-4ddcc20b54cf tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 07:43:04.660004 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c14ff0e4-42ff-48c1-a033-4ddcc20b54cf tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:04.660675 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c14ff0e4-42ff-48c1-a033-4ddcc20b54cf tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:04.661275 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c14ff0e4-42ff-48c1-a033-4ddcc20b54cf tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:04.662367 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c14ff0e4-42ff-48c1-a033-4ddcc20b54cf tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:04.663027 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c14ff0e4-42ff-48c1-a033-4ddcc20b54cf tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:04.663721 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c14ff0e4-42ff-48c1-a033-4ddcc20b54cf tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:04.683434 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.quota [None req-c14ff0e4-42ff-48c1-a033-4ddcc20b54cf tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Getting quotas for project ea75360af6084fa0a228bb86e711482a. Resources: {'cores', 'ram', 'instances'} {{(pid=127113) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:43:04.688932 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.quota [None req-c14ff0e4-42ff-48c1-a033-4ddcc20b54cf tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Getting quotas for user e7963a259502456da3f2113e08557a0f and project ea75360af6084fa0a228bb86e711482a. Resources: {'cores', 'ram', 'instances'} {{(pid=127113) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:43:04.703491 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-c14ff0e4-42ff-48c1-a033-4ddcc20b54cf tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Going to run 1 instances... {{(pid=127113) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 07:43:04.706358 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-c14ff0e4-42ff-48c1-a033-4ddcc20b54cf tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] [instance: b03f29f3-9610-46c2-908b-80a6029e29e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4358f547-a499-43f3-9c84-925d78cd73db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127113) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 07:43:04.762298 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-c14ff0e4-42ff-48c1-a033-4ddcc20b54cf tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.471846 Aug 24 07:43:04.763305 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 177/367] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 24 07:43:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 474 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 07:43:04.774185 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-2eb90938-107b-40d2-9536-042cd5ca719b tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:04.774817 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-2eb90938-107b-40d2-9536-042cd5ca719b tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] [instance: b03f29f3-9610-46c2-908b-80a6029e29e7] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:04.841727 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-2eb90938-107b-40d2-9536-042cd5ca719b tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7963a259502456da3f2113e08557a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea75360af6084fa0a228bb86e711482a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:04.848924 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-2eb90938-107b-40d2-9536-042cd5ca719b tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] 10.222.0.42 "GET /compute/v2.1/servers/b03f29f3-9610-46c2-908b-80a6029e29e7" status: 200 len: 1214 microversion: 2.1 time: 0.078873 Aug 24 07:43:04.849789 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 191/368] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:04 2022] GET /compute/v2.1/servers/b03f29f3-9610-46c2-908b-80a6029e29e7 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:43:05.007265 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-4863caf5-c8d4-4664-b5c4-7d1dff4ac3e6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:05.008143 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-4863caf5-c8d4-4664-b5c4-7d1dff4ac3e6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:05.016380 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4863caf5-c8d4-4664-b5c4-7d1dff4ac3e6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:05.017548 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4863caf5-c8d4-4664-b5c4-7d1dff4ac3e6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:05.018520 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4863caf5-c8d4-4664-b5c4-7d1dff4ac3e6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:05.020031 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4863caf5-c8d4-4664-b5c4-7d1dff4ac3e6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:05.020835 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4863caf5-c8d4-4664-b5c4-7d1dff4ac3e6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:05.021974 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4863caf5-c8d4-4664-b5c4-7d1dff4ac3e6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:05.501992 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-4863caf5-c8d4-4664-b5c4-7d1dff4ac3e6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:05.511064 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-4863caf5-c8d4-4664-b5c4-7d1dff4ac3e6 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de" status: 200 len: 1371 microversion: 2.1 time: 0.508794 Aug 24 07:43:05.518768 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 178/369] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:05 2022] GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de => generated 1371 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:05.872559 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-3ea0c9c9-3ce6-4070-b80b-e67726818131 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:05.873154 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-3ea0c9c9-3ce6-4070-b80b-e67726818131 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] [instance: b03f29f3-9610-46c2-908b-80a6029e29e7] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:05.880695 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3ea0c9c9-3ce6-4070-b80b-e67726818131 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:05.881428 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3ea0c9c9-3ce6-4070-b80b-e67726818131 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:05.882022 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3ea0c9c9-3ce6-4070-b80b-e67726818131 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:05.882901 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3ea0c9c9-3ce6-4070-b80b-e67726818131 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:05.883523 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3ea0c9c9-3ce6-4070-b80b-e67726818131 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:05.884105 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3ea0c9c9-3ce6-4070-b80b-e67726818131 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:05.991655 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-3ea0c9c9-3ce6-4070-b80b-e67726818131 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7963a259502456da3f2113e08557a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea75360af6084fa0a228bb86e711482a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:06.000215 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-3ea0c9c9-3ce6-4070-b80b-e67726818131 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] 10.222.0.42 "GET /compute/v2.1/servers/b03f29f3-9610-46c2-908b-80a6029e29e7" status: 200 len: 1218 microversion: 2.1 time: 0.132385 Aug 24 07:43:06.000770 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 192/370] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:05 2022] GET /compute/v2.1/servers/b03f29f3-9610-46c2-908b-80a6029e29e7 => generated 1218 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:06.536211 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-70206e29-7b4c-4681-91d7-7e7014fe6988 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:06.537461 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-70206e29-7b4c-4681-91d7-7e7014fe6988 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:06.544473 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-70206e29-7b4c-4681-91d7-7e7014fe6988 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:06.545218 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-70206e29-7b4c-4681-91d7-7e7014fe6988 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:06.545907 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-70206e29-7b4c-4681-91d7-7e7014fe6988 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:06.547074 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-70206e29-7b4c-4681-91d7-7e7014fe6988 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:06.547847 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-70206e29-7b4c-4681-91d7-7e7014fe6988 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:06.548414 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-70206e29-7b4c-4681-91d7-7e7014fe6988 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:06.738852 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-70206e29-7b4c-4681-91d7-7e7014fe6988 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:06.748441 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-70206e29-7b4c-4681-91d7-7e7014fe6988 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de" status: 200 len: 1565 microversion: 2.1 time: 0.218958 Aug 24 07:43:06.763187 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 179/371] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:06 2022] GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de => generated 1565 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:06.771190 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-b88f1c20-50cc-461b-8b12-f40a5629e5ff tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:06.771831 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-b88f1c20-50cc-461b-8b12-f40a5629e5ff tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:06.779448 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b88f1c20-50cc-461b-8b12-f40a5629e5ff tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:06.780260 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b88f1c20-50cc-461b-8b12-f40a5629e5ff tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:06.780925 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b88f1c20-50cc-461b-8b12-f40a5629e5ff tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:06.781912 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b88f1c20-50cc-461b-8b12-f40a5629e5ff tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:06.782720 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b88f1c20-50cc-461b-8b12-f40a5629e5ff tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:06.783587 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b88f1c20-50cc-461b-8b12-f40a5629e5ff tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:07.044119 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-69fcb4aa-b1bd-4a5f-99b4-09ddb95e99c1 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:07.047244 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-69fcb4aa-b1bd-4a5f-99b4-09ddb95e99c1 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] [instance: b03f29f3-9610-46c2-908b-80a6029e29e7] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:07.060977 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-69fcb4aa-b1bd-4a5f-99b4-09ddb95e99c1 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:07.061998 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-69fcb4aa-b1bd-4a5f-99b4-09ddb95e99c1 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:07.062745 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-69fcb4aa-b1bd-4a5f-99b4-09ddb95e99c1 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:07.063619 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-69fcb4aa-b1bd-4a5f-99b4-09ddb95e99c1 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:07.064231 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-69fcb4aa-b1bd-4a5f-99b4-09ddb95e99c1 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:07.064868 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-69fcb4aa-b1bd-4a5f-99b4-09ddb95e99c1 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:07.188384 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-69fcb4aa-b1bd-4a5f-99b4-09ddb95e99c1 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7963a259502456da3f2113e08557a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea75360af6084fa0a228bb86e711482a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:07.202018 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-69fcb4aa-b1bd-4a5f-99b4-09ddb95e99c1 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] 10.222.0.42 "GET /compute/v2.1/servers/b03f29f3-9610-46c2-908b-80a6029e29e7" status: 200 len: 1284 microversion: 2.1 time: 0.176379 Aug 24 07:43:07.202861 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 180/372] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:07 2022] GET /compute/v2.1/servers/b03f29f3-9610-46c2-908b-80a6029e29e7 => generated 1284 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:07.231142 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-b88f1c20-50cc-461b-8b12-f40a5629e5ff tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.463271 Aug 24 07:43:07.232567 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 193/373] 10.222.0.42 () {58 vars in 1275 bytes} [Wed Aug 24 07:43:06 2022] GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de/os-interface => generated 284 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:43:08.231845 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-0c4126cf-41f5-4f37-8660-cf958bef8b79 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:08.232472 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-0c4126cf-41f5-4f37-8660-cf958bef8b79 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] [instance: b03f29f3-9610-46c2-908b-80a6029e29e7] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:08.241818 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0c4126cf-41f5-4f37-8660-cf958bef8b79 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:08.242311 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0c4126cf-41f5-4f37-8660-cf958bef8b79 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:08.242773 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0c4126cf-41f5-4f37-8660-cf958bef8b79 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:08.243484 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0c4126cf-41f5-4f37-8660-cf958bef8b79 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:08.243936 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0c4126cf-41f5-4f37-8660-cf958bef8b79 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:08.244364 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0c4126cf-41f5-4f37-8660-cf958bef8b79 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:08.546643 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [req-e724e031-21c6-44e8-8755-bd275c08bbe9 req-c48d9f09-88a5-411f-921d-5374a4376a4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "177a69e5-5a8e-48a8-99a8-928790a6a4de", "tag": "4c3c99fa-7ec3-487c-bf8f-3f7c8ee8b4ff"}]} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:43:08.547385 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-0c4126cf-41f5-4f37-8660-cf958bef8b79 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7963a259502456da3f2113e08557a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea75360af6084fa0a228bb86e711482a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:08.555421 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-0c4126cf-41f5-4f37-8660-cf958bef8b79 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] 10.222.0.42 "GET /compute/v2.1/servers/b03f29f3-9610-46c2-908b-80a6029e29e7" status: 200 len: 1314 microversion: 2.1 time: 0.331910 Aug 24 07:43:08.557561 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 181/374] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:08 2022] GET /compute/v2.1/servers/b03f29f3-9610-46c2-908b-80a6029e29e7 => generated 1314 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:08.577949 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-e724e031-21c6-44e8-8755-bd275c08bbe9 req-c48d9f09-88a5-411f-921d-5374a4376a4c service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:08.578573 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-e724e031-21c6-44e8-8755-bd275c08bbe9 req-c48d9f09-88a5-411f-921d-5374a4376a4c service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:08.579116 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-e724e031-21c6-44e8-8755-bd275c08bbe9 req-c48d9f09-88a5-411f-921d-5374a4376a4c service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:08.594544 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.compute.server_external_events [req-e724e031-21c6-44e8-8755-bd275c08bbe9 req-c48d9f09-88a5-411f-921d-5374a4376a4c service nova] Creating event network-changed:4c3c99fa-7ec3-487c-bf8f-3f7c8ee8b4ff for instance 177a69e5-5a8e-48a8-99a8-928790a6a4de on hv-cinder-85427 Aug 24 07:43:08.601962 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [req-e724e031-21c6-44e8-8755-bd275c08bbe9 req-c48d9f09-88a5-411f-921d-5374a4376a4c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059294 Aug 24 07:43:08.603089 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 194/375] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:43:09.131886 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [req-c23bb99e-aeb2-434c-80c1-f36d9dac8f81 req-fb8143f1-94b4-4cf8-920f-04ffe9949c49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b03f29f3-9610-46c2-908b-80a6029e29e7", "tag": "02d2e54e-1c33-4911-9c16-6aae2c1e3dbf"}]} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:43:09.152236 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-c23bb99e-aeb2-434c-80c1-f36d9dac8f81 req-fb8143f1-94b4-4cf8-920f-04ffe9949c49 service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:09.152731 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-c23bb99e-aeb2-434c-80c1-f36d9dac8f81 req-fb8143f1-94b4-4cf8-920f-04ffe9949c49 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:09.153166 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-c23bb99e-aeb2-434c-80c1-f36d9dac8f81 req-fb8143f1-94b4-4cf8-920f-04ffe9949c49 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:09.192579 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:09.200765 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.compute.server_external_events [req-c23bb99e-aeb2-434c-80c1-f36d9dac8f81 req-fb8143f1-94b4-4cf8-920f-04ffe9949c49 service nova] Creating event network-changed:02d2e54e-1c33-4911-9c16-6aae2c1e3dbf for instance b03f29f3-9610-46c2-908b-80a6029e29e7 on hv-cinder-85427 Aug 24 07:43:09.216480 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [req-c23bb99e-aeb2-434c-80c1-f36d9dac8f81 req-fb8143f1-94b4-4cf8-920f-04ffe9949c49 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088685 Aug 24 07:43:09.223164 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 182/376] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:43:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:43:09.581804 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-3df1b788-e096-487b-9206-1a73a49269fd tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:09.583183 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-3df1b788-e096-487b-9206-1a73a49269fd tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] [instance: b03f29f3-9610-46c2-908b-80a6029e29e7] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:09.590878 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3df1b788-e096-487b-9206-1a73a49269fd tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:09.591704 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3df1b788-e096-487b-9206-1a73a49269fd tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:09.592357 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3df1b788-e096-487b-9206-1a73a49269fd tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:09.593714 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3df1b788-e096-487b-9206-1a73a49269fd tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:09.595205 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3df1b788-e096-487b-9206-1a73a49269fd tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:09.595841 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3df1b788-e096-487b-9206-1a73a49269fd tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:09.863272 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-3df1b788-e096-487b-9206-1a73a49269fd tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7963a259502456da3f2113e08557a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea75360af6084fa0a228bb86e711482a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:09.876787 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-3df1b788-e096-487b-9206-1a73a49269fd tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] 10.222.0.42 "GET /compute/v2.1/servers/b03f29f3-9610-46c2-908b-80a6029e29e7" status: 200 len: 1314 microversion: 2.1 time: 0.302722 Aug 24 07:43:09.886787 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 195/377] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:09 2022] GET /compute/v2.1/servers/b03f29f3-9610-46c2-908b-80a6029e29e7 => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:10.470609 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-a4b81876-9590-402f-a84a-e4dcbb236c97 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Action: 'create', calling method: .version_select at 0x7faf6805b430>, body: {"keypair": {"name": "tempest-keypair-444654930", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBuEjdfdQTGv0WulEzl5wYHWM9sgbK2I2OkIyx1CvkS8ng3oUJQsfrfPcikVtGygvlb/sG1O6It1PvC9AbfG0oqTfcS/rrJwOBHvBE43f4AXHPyVHFPSg0+q7G+/kC1mbA=="}} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:43:10.490221 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.quota [None req-a4b81876-9590-402f-a84a-e4dcbb236c97 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Getting quotas for project af5acb73124c485aa87e60b4e5d4f6d4. Resources: {'key_pairs'} {{(pid=127113) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:43:10.494686 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.quota [None req-a4b81876-9590-402f-a84a-e4dcbb236c97 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Getting quotas for user f594c9344b2c472ba33ceef87ec88a0b and project af5acb73124c485aa87e60b4e5d4f6d4. Resources: {'key_pairs'} {{(pid=127113) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:43:10.525905 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-a4b81876-9590-402f-a84a-e4dcbb236c97 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.061776 Aug 24 07:43:10.526859 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 183/378] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Aug 24 07:43:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:43:10.588876 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-c985f26c-3158-4e52-8cbe-f5a50d9547fb tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-503393103", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2141614004", "security_groups": [{"name": "tempest-secgroup-smoke-2065229898"}], "block_device_mapping_v2": [{"uuid": "29f7517c-1620-4ae5-9ef5-4293686c8688", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6249c133-fde8-4248-b989-66dfa30799de"}]}} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:43:10.811200 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.network.neutron [None req-c985f26c-3158-4e52-8cbe-f5a50d9547fb tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] validate_networks() for [('6249c133-fde8-4248-b989-66dfa30799de', None, None, None, None, None)] {{(pid=127114) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 07:43:10.902068 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-73c4e7cc-7b00-43c8-b153-925984a1f43c tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:10.903083 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-73c4e7cc-7b00-43c8-b153-925984a1f43c tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] [instance: b03f29f3-9610-46c2-908b-80a6029e29e7] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:10.917370 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-73c4e7cc-7b00-43c8-b153-925984a1f43c tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:10.919768 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-73c4e7cc-7b00-43c8-b153-925984a1f43c tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:10.920319 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-73c4e7cc-7b00-43c8-b153-925984a1f43c tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:10.921156 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-73c4e7cc-7b00-43c8-b153-925984a1f43c tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:10.924317 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-73c4e7cc-7b00-43c8-b153-925984a1f43c tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:10.924858 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-73c4e7cc-7b00-43c8-b153-925984a1f43c tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:11.199512 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-73c4e7cc-7b00-43c8-b153-925984a1f43c tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7963a259502456da3f2113e08557a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea75360af6084fa0a228bb86e711482a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:11.211787 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-73c4e7cc-7b00-43c8-b153-925984a1f43c tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] 10.222.0.42 "GET /compute/v2.1/servers/b03f29f3-9610-46c2-908b-80a6029e29e7" status: 200 len: 1314 microversion: 2.1 time: 0.314369 Aug 24 07:43:11.212481 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 184/379] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:10 2022] GET /compute/v2.1/servers/b03f29f3-9610-46c2-908b-80a6029e29e7 => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:11.838669 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-c985f26c-3158-4e52-8cbe-f5a50d9547fb tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Flavor limits 0:0:0 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 07:43:11.840610 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-c985f26c-3158-4e52-8cbe-f5a50d9547fb tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Image limits 0:0:0 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 07:43:11.841337 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-c985f26c-3158-4e52-8cbe-f5a50d9547fb tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Flavor pref 0:0:0 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 07:43:11.841973 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-c985f26c-3158-4e52-8cbe-f5a50d9547fb tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Image pref 0:0:0 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 07:43:11.843289 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-c985f26c-3158-4e52-8cbe-f5a50d9547fb tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 07:43:11.861743 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c985f26c-3158-4e52-8cbe-f5a50d9547fb tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:11.862373 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c985f26c-3158-4e52-8cbe-f5a50d9547fb tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:11.863701 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c985f26c-3158-4e52-8cbe-f5a50d9547fb tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:11.864459 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c985f26c-3158-4e52-8cbe-f5a50d9547fb tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:11.865105 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c985f26c-3158-4e52-8cbe-f5a50d9547fb tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:11.865692 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c985f26c-3158-4e52-8cbe-f5a50d9547fb tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:11.873715 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell1:SELECT=100 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:11.887504 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.quota [None req-c985f26c-3158-4e52-8cbe-f5a50d9547fb tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Getting quotas for project e97fd16d61ef4d5ebc5f435ae8a18561. Resources: {'cores', 'ram', 'instances'} {{(pid=127114) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:43:11.892365 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.quota [None req-c985f26c-3158-4e52-8cbe-f5a50d9547fb tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Getting quotas for user 760115e8fb554582a016445f9aadc00c and project e97fd16d61ef4d5ebc5f435ae8a18561. Resources: {'cores', 'ram', 'instances'} {{(pid=127114) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:43:11.959434 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-c985f26c-3158-4e52-8cbe-f5a50d9547fb tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Going to run 1 instances... {{(pid=127114) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 07:43:11.961761 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-c985f26c-3158-4e52-8cbe-f5a50d9547fb tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 6f20697e-980b-4345-addc-d4907757ff37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='29f7517c-1620-4ae5-9ef5-4293686c8688',volume_size=None,volume_type=None)] {{(pid=127114) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 07:43:12.181670 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-c985f26c-3158-4e52-8cbe-f5a50d9547fb tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.602573 Aug 24 07:43:12.182607 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 196/380] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 24 07:43:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 1604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 07:43:12.193407 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-0bae1dd9-0283-4b41-9828-0b99a50fbad3 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:12.194002 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-0bae1dd9-0283-4b41-9828-0b99a50fbad3 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 6f20697e-980b-4345-addc-d4907757ff37] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:12.245942 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-04f9770a-4121-4201-aec3-0e6be4f03a74 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:12.247962 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-04f9770a-4121-4201-aec3-0e6be4f03a74 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] [instance: b03f29f3-9610-46c2-908b-80a6029e29e7] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:12.260979 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-04f9770a-4121-4201-aec3-0e6be4f03a74 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:12.262224 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-04f9770a-4121-4201-aec3-0e6be4f03a74 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:12.264823 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-04f9770a-4121-4201-aec3-0e6be4f03a74 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:12.265572 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-04f9770a-4121-4201-aec3-0e6be4f03a74 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:12.266032 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-04f9770a-4121-4201-aec3-0e6be4f03a74 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:12.267264 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-04f9770a-4121-4201-aec3-0e6be4f03a74 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:12.361419 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-0bae1dd9-0283-4b41-9828-0b99a50fbad3 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:12.387976 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-0bae1dd9-0283-4b41-9828-0b99a50fbad3 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37" status: 200 len: 1094 microversion: 2.1 time: 0.198340 Aug 24 07:43:12.388568 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 185/381] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:12 2022] GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37 => generated 1094 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:12.398792 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-04b7c967-8998-4c9b-8dd5-5ebde18a3262 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:12.408528 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-04b7c967-8998-4c9b-8dd5-5ebde18a3262 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] [instance: 7a4bf12e-c36e-425e-bd1f-181bd4326de3] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:12.421133 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-04b7c967-8998-4c9b-8dd5-5ebde18a3262 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:12.424302 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-04b7c967-8998-4c9b-8dd5-5ebde18a3262 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:12.424982 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-04b7c967-8998-4c9b-8dd5-5ebde18a3262 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:12.426744 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-04b7c967-8998-4c9b-8dd5-5ebde18a3262 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:12.428568 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-04b7c967-8998-4c9b-8dd5-5ebde18a3262 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:12.430373 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-04b7c967-8998-4c9b-8dd5-5ebde18a3262 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:12.475742 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-04b7c967-8998-4c9b-8dd5-5ebde18a3262 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] [instance: 7a4bf12e-c36e-425e-bd1f-181bd4326de3] Going to try to terminate instance {{(pid=127113) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 07:43:12.489008 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-04f9770a-4121-4201-aec3-0e6be4f03a74 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7963a259502456da3f2113e08557a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea75360af6084fa0a228bb86e711482a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:12.516744 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-04f9770a-4121-4201-aec3-0e6be4f03a74 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] 10.222.0.42 "GET /compute/v2.1/servers/b03f29f3-9610-46c2-908b-80a6029e29e7" status: 200 len: 1314 microversion: 2.1 time: 0.287687 Aug 24 07:43:12.518001 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 197/382] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:12 2022] GET /compute/v2.1/servers/b03f29f3-9610-46c2-908b-80a6029e29e7 => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:43:12.630070 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-04b7c967-8998-4c9b-8dd5-5ebde18a3262 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7a4bf12e-c36e-425e-bd1f-181bd4326de3" status: 204 len: 0 microversion: 2.1 time: 0.234057 Aug 24 07:43:12.635078 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 186/383] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 24 07:43:12 2022] DELETE /compute/v2.1/servers/7a4bf12e-c36e-425e-bd1f-181bd4326de3 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 07:43:12.640704 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-d5b1100d-d726-491b-95a0-02e16e32396a tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:12.641333 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-d5b1100d-d726-491b-95a0-02e16e32396a tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] [instance: 7a4bf12e-c36e-425e-bd1f-181bd4326de3] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:12.651848 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d5b1100d-d726-491b-95a0-02e16e32396a tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:12.652337 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d5b1100d-d726-491b-95a0-02e16e32396a tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:12.652770 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d5b1100d-d726-491b-95a0-02e16e32396a tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:12.657322 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d5b1100d-d726-491b-95a0-02e16e32396a tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:12.658226 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d5b1100d-d726-491b-95a0-02e16e32396a tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:12.659267 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d5b1100d-d726-491b-95a0-02e16e32396a tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:12.800731 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-5d722c53-b9ca-4135-befd-49a59ee0d68f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1296932847", "imageRef": "4358f547-a499-43f3-9c84-925d78cd73db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "34afa070-0362-4f42-ac1a-67e0122ae46a"}], "security_groups": [{"name": "tempest-securitygroup--691732243"}], "key_name": "tempest-keypair-444654930", "user_data": "}} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:43:12.906007 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-d5b1100d-d726-491b-95a0-02e16e32396a tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74594b3982264446b73d14bad3f46045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf922510f54d4d40ac00486394d67a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:12.917728 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-d5b1100d-d726-491b-95a0-02e16e32396a tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] 10.222.0.42 "GET /compute/v2.1/servers/7a4bf12e-c36e-425e-bd1f-181bd4326de3" status: 200 len: 1514 microversion: 2.1 time: 0.281825 Aug 24 07:43:12.918932 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 198/384] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:12 2022] GET /compute/v2.1/servers/7a4bf12e-c36e-425e-bd1f-181bd4326de3 => generated 1514 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:12.965088 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.network.neutron [None req-5d722c53-b9ca-4135-befd-49a59ee0d68f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] validate_networks() for [('34afa070-0362-4f42-ac1a-67e0122ae46a', None, None, None, None, None)] {{(pid=127113) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 07:43:13.410705 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-a45a7cc3-0dc2-4de5-9f1d-f1dde904a127 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:13.411180 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.virt.hardware [None req-5d722c53-b9ca-4135-befd-49a59ee0d68f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Flavor limits 0:0:0 {{(pid=127113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 07:43:13.411689 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-a45a7cc3-0dc2-4de5-9f1d-f1dde904a127 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 6f20697e-980b-4345-addc-d4907757ff37] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:13.412376 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.virt.hardware [None req-5d722c53-b9ca-4135-befd-49a59ee0d68f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Image limits 0:0:0 {{(pid=127113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 07:43:13.413020 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.virt.hardware [None req-5d722c53-b9ca-4135-befd-49a59ee0d68f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Flavor pref 0:0:0 {{(pid=127113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 07:43:13.413479 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.virt.hardware [None req-5d722c53-b9ca-4135-befd-49a59ee0d68f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Image pref 0:0:0 {{(pid=127113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 07:43:13.414708 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.virt.hardware [None req-5d722c53-b9ca-4135-befd-49a59ee0d68f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 07:43:13.418466 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a45a7cc3-0dc2-4de5-9f1d-f1dde904a127 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:13.419236 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a45a7cc3-0dc2-4de5-9f1d-f1dde904a127 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:13.419783 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a45a7cc3-0dc2-4de5-9f1d-f1dde904a127 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:13.420484 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a45a7cc3-0dc2-4de5-9f1d-f1dde904a127 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:13.421138 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a45a7cc3-0dc2-4de5-9f1d-f1dde904a127 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:13.421726 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a45a7cc3-0dc2-4de5-9f1d-f1dde904a127 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:13.432894 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5d722c53-b9ca-4135-befd-49a59ee0d68f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:13.433883 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5d722c53-b9ca-4135-befd-49a59ee0d68f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:13.435364 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5d722c53-b9ca-4135-befd-49a59ee0d68f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:13.436759 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5d722c53-b9ca-4135-befd-49a59ee0d68f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:13.437849 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5d722c53-b9ca-4135-befd-49a59ee0d68f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:13.438865 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5d722c53-b9ca-4135-befd-49a59ee0d68f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:13.469095 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.quota [None req-5d722c53-b9ca-4135-befd-49a59ee0d68f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Getting quotas for project af5acb73124c485aa87e60b4e5d4f6d4. Resources: {'cores', 'ram', 'instances'} {{(pid=127113) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:43:13.475478 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.quota [None req-5d722c53-b9ca-4135-befd-49a59ee0d68f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Getting quotas for user f594c9344b2c472ba33ceef87ec88a0b and project af5acb73124c485aa87e60b4e5d4f6d4. Resources: {'cores', 'ram', 'instances'} {{(pid=127113) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:43:13.488972 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-5d722c53-b9ca-4135-befd-49a59ee0d68f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Going to run 1 instances... {{(pid=127113) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 07:43:13.491823 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-5d722c53-b9ca-4135-befd-49a59ee0d68f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: 851572e6-8dda-401b-aab8-58fbe54a2b31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4358f547-a499-43f3-9c84-925d78cd73db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127113) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 07:43:13.492741 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-a45a7cc3-0dc2-4de5-9f1d-f1dde904a127 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:13.501343 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-a45a7cc3-0dc2-4de5-9f1d-f1dde904a127 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37" status: 200 len: 1144 microversion: 2.1 time: 0.095659 Aug 24 07:43:13.501921 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 199/385] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:13 2022] GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37 => generated 1144 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:43:13.543635 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-c029559b-d084-4a25-b7fc-ac4a5555fb7f tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:13.546114 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-c029559b-d084-4a25-b7fc-ac4a5555fb7f tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] [instance: b03f29f3-9610-46c2-908b-80a6029e29e7] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:13.556308 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c029559b-d084-4a25-b7fc-ac4a5555fb7f tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:13.557368 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c029559b-d084-4a25-b7fc-ac4a5555fb7f tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:13.558044 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c029559b-d084-4a25-b7fc-ac4a5555fb7f tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:13.558938 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c029559b-d084-4a25-b7fc-ac4a5555fb7f tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:13.559558 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c029559b-d084-4a25-b7fc-ac4a5555fb7f tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:13.560179 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c029559b-d084-4a25-b7fc-ac4a5555fb7f tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:13.587194 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-5d722c53-b9ca-4135-befd-49a59ee0d68f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.792215 Aug 24 07:43:13.588738 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 187/386] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 24 07:43:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 07:43:13.601879 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-b8c3843e-d455-44c0-9d9a-77c475071184 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:13.602850 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-b8c3843e-d455-44c0-9d9a-77c475071184 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: 851572e6-8dda-401b-aab8-58fbe54a2b31] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:13.681505 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-b8c3843e-d455-44c0-9d9a-77c475071184 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:13.699162 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-b8c3843e-d455-44c0-9d9a-77c475071184 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31" status: 200 len: 1241 microversion: 2.1 time: 0.102376 Aug 24 07:43:13.699824 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 188/387] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:13 2022] GET /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31 => generated 1241 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:43:13.788863 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-c029559b-d084-4a25-b7fc-ac4a5555fb7f tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7963a259502456da3f2113e08557a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea75360af6084fa0a228bb86e711482a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:13.797530 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-c029559b-d084-4a25-b7fc-ac4a5555fb7f tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] 10.222.0.42 "GET /compute/v2.1/servers/b03f29f3-9610-46c2-908b-80a6029e29e7" status: 200 len: 1314 microversion: 2.1 time: 0.263792 Aug 24 07:43:13.811922 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 200/388] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:13 2022] GET /compute/v2.1/servers/b03f29f3-9610-46c2-908b-80a6029e29e7 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:43:13.939121 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-e1ef40f3-1f67-49d8-8c0e-00763de0e50d tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:13.939880 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-e1ef40f3-1f67-49d8-8c0e-00763de0e50d tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] [instance: 7a4bf12e-c36e-425e-bd1f-181bd4326de3] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:13.948407 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e1ef40f3-1f67-49d8-8c0e-00763de0e50d tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:13.948996 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e1ef40f3-1f67-49d8-8c0e-00763de0e50d tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:13.949565 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e1ef40f3-1f67-49d8-8c0e-00763de0e50d tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:13.950735 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e1ef40f3-1f67-49d8-8c0e-00763de0e50d tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:13.951399 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e1ef40f3-1f67-49d8-8c0e-00763de0e50d tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:13.952331 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e1ef40f3-1f67-49d8-8c0e-00763de0e50d tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:14.134339 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-e1ef40f3-1f67-49d8-8c0e-00763de0e50d tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74594b3982264446b73d14bad3f46045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf922510f54d4d40ac00486394d67a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:14.145281 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-e1ef40f3-1f67-49d8-8c0e-00763de0e50d tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] 10.222.0.42 "GET /compute/v2.1/servers/7a4bf12e-c36e-425e-bd1f-181bd4326de3" status: 200 len: 1514 microversion: 2.1 time: 0.209589 Aug 24 07:43:14.146464 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 189/389] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:13 2022] GET /compute/v2.1/servers/7a4bf12e-c36e-425e-bd1f-181bd4326de3 => generated 1514 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:14.528528 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-36cd11b3-0cc4-47a9-874d-fc627835b4c2 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:14.530466 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-36cd11b3-0cc4-47a9-874d-fc627835b4c2 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 6f20697e-980b-4345-addc-d4907757ff37] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:14.546652 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-36cd11b3-0cc4-47a9-874d-fc627835b4c2 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:14.547950 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-36cd11b3-0cc4-47a9-874d-fc627835b4c2 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:14.549063 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-36cd11b3-0cc4-47a9-874d-fc627835b4c2 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:14.550817 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-36cd11b3-0cc4-47a9-874d-fc627835b4c2 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:14.551576 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-36cd11b3-0cc4-47a9-874d-fc627835b4c2 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:14.553511 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-36cd11b3-0cc4-47a9-874d-fc627835b4c2 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:14.725310 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-36cd11b3-0cc4-47a9-874d-fc627835b4c2 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:14.726240 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-ebaaf43a-eb27-4f46-8152-3ad2ddad31b1 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:14.729129 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-ebaaf43a-eb27-4f46-8152-3ad2ddad31b1 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: 851572e6-8dda-401b-aab8-58fbe54a2b31] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:14.745363 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ebaaf43a-eb27-4f46-8152-3ad2ddad31b1 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:14.745858 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ebaaf43a-eb27-4f46-8152-3ad2ddad31b1 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:14.746433 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ebaaf43a-eb27-4f46-8152-3ad2ddad31b1 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:14.747175 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ebaaf43a-eb27-4f46-8152-3ad2ddad31b1 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:14.747623 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ebaaf43a-eb27-4f46-8152-3ad2ddad31b1 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:14.748097 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ebaaf43a-eb27-4f46-8152-3ad2ddad31b1 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:14.749139 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-36cd11b3-0cc4-47a9-874d-fc627835b4c2 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37" status: 200 len: 1144 microversion: 2.1 time: 0.225255 Aug 24 07:43:14.762874 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 201/390] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:14 2022] GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37 => generated 1144 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:14.820494 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-ebaaf43a-eb27-4f46-8152-3ad2ddad31b1 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:14.823030 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-0cb199be-68f1-4143-b5ca-f130120841fe tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:14.823933 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-0cb199be-68f1-4143-b5ca-f130120841fe tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] [instance: b03f29f3-9610-46c2-908b-80a6029e29e7] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:14.828795 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-ebaaf43a-eb27-4f46-8152-3ad2ddad31b1 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31" status: 200 len: 1245 microversion: 2.1 time: 0.112940 Aug 24 07:43:14.829920 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 190/391] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:14 2022] GET /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31 => generated 1245 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:14.833089 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0cb199be-68f1-4143-b5ca-f130120841fe tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:14.833571 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0cb199be-68f1-4143-b5ca-f130120841fe tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:14.834006 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0cb199be-68f1-4143-b5ca-f130120841fe tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:14.834724 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0cb199be-68f1-4143-b5ca-f130120841fe tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:14.835190 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0cb199be-68f1-4143-b5ca-f130120841fe tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:14.835684 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0cb199be-68f1-4143-b5ca-f130120841fe tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:15.135143 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-0cb199be-68f1-4143-b5ca-f130120841fe tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7963a259502456da3f2113e08557a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea75360af6084fa0a228bb86e711482a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:15.148409 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-0cb199be-68f1-4143-b5ca-f130120841fe tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] 10.222.0.42 "GET /compute/v2.1/servers/b03f29f3-9610-46c2-908b-80a6029e29e7" status: 200 len: 1314 microversion: 2.1 time: 0.332871 Aug 24 07:43:15.151493 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 202/392] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:14 2022] GET /compute/v2.1/servers/b03f29f3-9610-46c2-908b-80a6029e29e7 => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:15.168212 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-b9931c52-d790-4ff9-ac79-056d7c6b6afe tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:15.169178 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-b9931c52-d790-4ff9-ac79-056d7c6b6afe tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] [instance: 7a4bf12e-c36e-425e-bd1f-181bd4326de3] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:15.179633 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b9931c52-d790-4ff9-ac79-056d7c6b6afe tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:15.180512 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b9931c52-d790-4ff9-ac79-056d7c6b6afe tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:15.182198 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b9931c52-d790-4ff9-ac79-056d7c6b6afe tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:15.187729 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b9931c52-d790-4ff9-ac79-056d7c6b6afe tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:15.188561 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b9931c52-d790-4ff9-ac79-056d7c6b6afe tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:15.189388 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b9931c52-d790-4ff9-ac79-056d7c6b6afe tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:15.430606 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-b9931c52-d790-4ff9-ac79-056d7c6b6afe tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74594b3982264446b73d14bad3f46045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf922510f54d4d40ac00486394d67a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:15.442081 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-b9931c52-d790-4ff9-ac79-056d7c6b6afe tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] 10.222.0.42 "GET /compute/v2.1/servers/7a4bf12e-c36e-425e-bd1f-181bd4326de3" status: 200 len: 1514 microversion: 2.1 time: 0.278059 Aug 24 07:43:15.442810 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 191/393] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:15 2022] GET /compute/v2.1/servers/7a4bf12e-c36e-425e-bd1f-181bd4326de3 => generated 1514 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:15.777343 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-203081b6-147c-483e-9c79-0e43a785ef36 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:15.778601 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-203081b6-147c-483e-9c79-0e43a785ef36 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 6f20697e-980b-4345-addc-d4907757ff37] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:15.788972 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-203081b6-147c-483e-9c79-0e43a785ef36 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:15.790098 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-203081b6-147c-483e-9c79-0e43a785ef36 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:15.790829 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-203081b6-147c-483e-9c79-0e43a785ef36 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:15.791306 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [req-6621dbaa-d44c-47cd-98e2-eeb1a02f270f req-c4de1e97-a94e-463f-8e68-cd8970395918 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a4bf12e-c36e-425e-bd1f-181bd4326de3", "name": "network-vif-deleted", "tag": "51836419-0dfc-4a1a-b731-432c8a87e9fb"}]} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:43:15.792717 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-203081b6-147c-483e-9c79-0e43a785ef36 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:15.793401 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-203081b6-147c-483e-9c79-0e43a785ef36 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:15.794474 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-203081b6-147c-483e-9c79-0e43a785ef36 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:15.819648 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-6621dbaa-d44c-47cd-98e2-eeb1a02f270f req-c4de1e97-a94e-463f-8e68-cd8970395918 service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:15.820139 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-6621dbaa-d44c-47cd-98e2-eeb1a02f270f req-c4de1e97-a94e-463f-8e68-cd8970395918 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:15.824317 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-6621dbaa-d44c-47cd-98e2-eeb1a02f270f req-c4de1e97-a94e-463f-8e68-cd8970395918 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:15.871376 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.compute.server_external_events [req-6621dbaa-d44c-47cd-98e2-eeb1a02f270f req-c4de1e97-a94e-463f-8e68-cd8970395918 service nova] Creating event network-vif-deleted:51836419-0dfc-4a1a-b731-432c8a87e9fb for instance 7a4bf12e-c36e-425e-bd1f-181bd4326de3 on hv-cinder-85427 Aug 24 07:43:15.881572 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [req-6621dbaa-d44c-47cd-98e2-eeb1a02f270f req-c4de1e97-a94e-463f-8e68-cd8970395918 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093126 Aug 24 07:43:15.883214 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 192/394] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:43:15.910437 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-6fed2dfe-4cdc-4b3c-97a3-d7fd0dba67c5 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:15.912996 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-6fed2dfe-4cdc-4b3c-97a3-d7fd0dba67c5 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: 851572e6-8dda-401b-aab8-58fbe54a2b31] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:15.923553 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6fed2dfe-4cdc-4b3c-97a3-d7fd0dba67c5 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:15.924306 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6fed2dfe-4cdc-4b3c-97a3-d7fd0dba67c5 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:15.925109 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6fed2dfe-4cdc-4b3c-97a3-d7fd0dba67c5 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:15.927242 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6fed2dfe-4cdc-4b3c-97a3-d7fd0dba67c5 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:15.927870 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6fed2dfe-4cdc-4b3c-97a3-d7fd0dba67c5 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:15.929133 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6fed2dfe-4cdc-4b3c-97a3-d7fd0dba67c5 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:15.963268 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-203081b6-147c-483e-9c79-0e43a785ef36 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:15.971441 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-203081b6-147c-483e-9c79-0e43a785ef36 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37" status: 200 len: 1192 microversion: 2.1 time: 0.204326 Aug 24 07:43:15.976714 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 203/395] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:15 2022] GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37 => generated 1192 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:16.135929 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-6fed2dfe-4cdc-4b3c-97a3-d7fd0dba67c5 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:16.150928 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-6fed2dfe-4cdc-4b3c-97a3-d7fd0dba67c5 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31" status: 200 len: 1301 microversion: 2.1 time: 0.261416 Aug 24 07:43:16.152257 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 193/396] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:15 2022] GET /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31 => generated 1301 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:16.172895 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-ef36ec8c-509c-4e01-a6b9-9cddc4646c64 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:16.173521 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-ef36ec8c-509c-4e01-a6b9-9cddc4646c64 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] [instance: b03f29f3-9610-46c2-908b-80a6029e29e7] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:16.186015 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ef36ec8c-509c-4e01-a6b9-9cddc4646c64 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:16.187285 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ef36ec8c-509c-4e01-a6b9-9cddc4646c64 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:16.189999 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ef36ec8c-509c-4e01-a6b9-9cddc4646c64 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:16.192378 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ef36ec8c-509c-4e01-a6b9-9cddc4646c64 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:16.196342 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ef36ec8c-509c-4e01-a6b9-9cddc4646c64 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:16.197125 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ef36ec8c-509c-4e01-a6b9-9cddc4646c64 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:16.392872 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-ef36ec8c-509c-4e01-a6b9-9cddc4646c64 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7963a259502456da3f2113e08557a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea75360af6084fa0a228bb86e711482a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:16.401936 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-ef36ec8c-509c-4e01-a6b9-9cddc4646c64 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] 10.222.0.42 "GET /compute/v2.1/servers/b03f29f3-9610-46c2-908b-80a6029e29e7" status: 200 len: 1314 microversion: 2.1 time: 0.232904 Aug 24 07:43:16.402859 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 204/397] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:16 2022] GET /compute/v2.1/servers/b03f29f3-9610-46c2-908b-80a6029e29e7 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:16.481668 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-aab577ab-0426-431e-b43b-ab78bfb5b53f tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:16.482499 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-aab577ab-0426-431e-b43b-ab78bfb5b53f tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] [instance: 7a4bf12e-c36e-425e-bd1f-181bd4326de3] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:16.497727 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-aab577ab-0426-431e-b43b-ab78bfb5b53f tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:16.508972 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-aab577ab-0426-431e-b43b-ab78bfb5b53f tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:16.509402 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-aab577ab-0426-431e-b43b-ab78bfb5b53f tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:16.511595 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-aab577ab-0426-431e-b43b-ab78bfb5b53f tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:16.526284 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-aab577ab-0426-431e-b43b-ab78bfb5b53f tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:16.529612 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-aab577ab-0426-431e-b43b-ab78bfb5b53f tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:16.636734 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-aab577ab-0426-431e-b43b-ab78bfb5b53f tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:16.641041 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-aab577ab-0426-431e-b43b-ab78bfb5b53f tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:16.645632 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-aab577ab-0426-431e-b43b-ab78bfb5b53f tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:16.646376 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.objects.instance [None req-aab577ab-0426-431e-b43b-ab78bfb5b53f tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lazy-loading 'fault' on Instance uuid 7a4bf12e-c36e-425e-bd1f-181bd4326de3 {{(pid=127113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:43:16.743699 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-aab577ab-0426-431e-b43b-ab78bfb5b53f tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74594b3982264446b73d14bad3f46045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf922510f54d4d40ac00486394d67a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:16.760572 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-aab577ab-0426-431e-b43b-ab78bfb5b53f tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] 10.222.0.42 "GET /compute/v2.1/servers/7a4bf12e-c36e-425e-bd1f-181bd4326de3" status: 200 len: 1309 microversion: 2.1 time: 0.286748 Aug 24 07:43:16.761154 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 194/398] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:16 2022] GET /compute/v2.1/servers/7a4bf12e-c36e-425e-bd1f-181bd4326de3 => generated 1309 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:16.999397 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-c58bf177-2444-4b31-8fcd-3e5aa4e2d493 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:17.001691 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-c58bf177-2444-4b31-8fcd-3e5aa4e2d493 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 6f20697e-980b-4345-addc-d4907757ff37] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:17.010810 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c58bf177-2444-4b31-8fcd-3e5aa4e2d493 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:17.012440 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c58bf177-2444-4b31-8fcd-3e5aa4e2d493 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:17.013216 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c58bf177-2444-4b31-8fcd-3e5aa4e2d493 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:17.014175 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c58bf177-2444-4b31-8fcd-3e5aa4e2d493 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:17.014884 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c58bf177-2444-4b31-8fcd-3e5aa4e2d493 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:17.015548 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c58bf177-2444-4b31-8fcd-3e5aa4e2d493 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:17.114239 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-c58bf177-2444-4b31-8fcd-3e5aa4e2d493 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:17.126854 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-c58bf177-2444-4b31-8fcd-3e5aa4e2d493 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37" status: 200 len: 1210 microversion: 2.1 time: 0.130112 Aug 24 07:43:17.129601 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 205/399] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:16 2022] GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37 => generated 1210 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:17.185444 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-6cacf78e-be56-49f2-a6c3-44ad3170e72d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:17.187405 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-6cacf78e-be56-49f2-a6c3-44ad3170e72d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: 851572e6-8dda-401b-aab8-58fbe54a2b31] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:17.209315 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6cacf78e-be56-49f2-a6c3-44ad3170e72d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:17.210168 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6cacf78e-be56-49f2-a6c3-44ad3170e72d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:17.210944 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6cacf78e-be56-49f2-a6c3-44ad3170e72d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:17.213015 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6cacf78e-be56-49f2-a6c3-44ad3170e72d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:17.214127 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6cacf78e-be56-49f2-a6c3-44ad3170e72d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:17.215182 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6cacf78e-be56-49f2-a6c3-44ad3170e72d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:17.351512 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-6cacf78e-be56-49f2-a6c3-44ad3170e72d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:17.378451 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-6cacf78e-be56-49f2-a6c3-44ad3170e72d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31" status: 200 len: 1299 microversion: 2.1 time: 0.205317 Aug 24 07:43:17.379132 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 195/400] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:17 2022] GET /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31 => generated 1299 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:17.429546 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-c7e3ab50-36e7-42cd-8ed3-4cfea0e995d8 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:17.430154 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-c7e3ab50-36e7-42cd-8ed3-4cfea0e995d8 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] [instance: b03f29f3-9610-46c2-908b-80a6029e29e7] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:17.433256 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:17.450032 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c7e3ab50-36e7-42cd-8ed3-4cfea0e995d8 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:17.450989 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c7e3ab50-36e7-42cd-8ed3-4cfea0e995d8 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:17.452599 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c7e3ab50-36e7-42cd-8ed3-4cfea0e995d8 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:17.455229 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c7e3ab50-36e7-42cd-8ed3-4cfea0e995d8 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:17.458586 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c7e3ab50-36e7-42cd-8ed3-4cfea0e995d8 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:17.459223 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c7e3ab50-36e7-42cd-8ed3-4cfea0e995d8 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:17.737095 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-c7e3ab50-36e7-42cd-8ed3-4cfea0e995d8 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7963a259502456da3f2113e08557a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea75360af6084fa0a228bb86e711482a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:17.766962 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-c7e3ab50-36e7-42cd-8ed3-4cfea0e995d8 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] 10.222.0.42 "GET /compute/v2.1/servers/b03f29f3-9610-46c2-908b-80a6029e29e7" status: 200 len: 1314 microversion: 2.1 time: 0.329335 Aug 24 07:43:17.779437 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 206/401] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:17 2022] GET /compute/v2.1/servers/b03f29f3-9610-46c2-908b-80a6029e29e7 => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:17.787551 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-b7ba34e2-2b6f-4cbb-8467-a417d39b3e37 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:17.787983 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-b7ba34e2-2b6f-4cbb-8467-a417d39b3e37 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] [instance: 7a4bf12e-c36e-425e-bd1f-181bd4326de3] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:17.799386 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b7ba34e2-2b6f-4cbb-8467-a417d39b3e37 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:17.800534 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b7ba34e2-2b6f-4cbb-8467-a417d39b3e37 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:17.801447 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b7ba34e2-2b6f-4cbb-8467-a417d39b3e37 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:17.803523 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b7ba34e2-2b6f-4cbb-8467-a417d39b3e37 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:17.806201 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b7ba34e2-2b6f-4cbb-8467-a417d39b3e37 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:17.808068 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b7ba34e2-2b6f-4cbb-8467-a417d39b3e37 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:17.835675 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.wsgi [None req-b7ba34e2-2b6f-4cbb-8467-a417d39b3e37 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] HTTP exception thrown: Instance 7a4bf12e-c36e-425e-bd1f-181bd4326de3 could not be found. Aug 24 07:43:17.837966 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-b7ba34e2-2b6f-4cbb-8467-a417d39b3e37 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Request method failure captured: Aug 24 07:43:17.837966 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: request: GET /compute/v2.1/servers/7a4bf12e-c36e-425e-bd1f-181bd4326de3 HTTP/1.1 Aug 24 07:43:17.837966 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept: application/json Aug 24 07:43:17.837966 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept-Encoding: identity Aug 24 07:43:17.837966 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Connection: close Aug 24 07:43:17.837966 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Length: 0 Aug 24 07:43:17.837966 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Type: application/json Aug 24 07:43:17.837966 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Host: 10.222.0.42 Aug 24 07:43:17.837966 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Openstack-System-Scope: None Aug 24 07:43:17.837966 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: User-Agent: python-urllib3/1.26.11 Aug 24 07:43:17.837966 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Auth-Token: gAAAAABjBdYciPoQpvfDOrS3F5GIgjEV8TG8w1hh9eyilnPxemjR5t0uHqtNbHUV9vIX1jlNZICq0fG7uoXfirqURg6PIX6DtYxIKM5JZcaJ9fEBuPa6E3MJNqLaA_t8lxf3HpkxKQCTW1Bbq3NJAvprRhfYuQo3KFp2asHoRiXgAgsNPA_-jh8 Aug 24 07:43:17.837966 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Id: None Aug 24 07:43:17.837966 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Name: None Aug 24 07:43:17.837966 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Identity-Status: Confirmed Aug 24 07:43:17.837966 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Is-Admin-Project: True Aug 24 07:43:17.837966 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Id: default Aug 24 07:43:17.837966 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Name: Default Aug 24 07:43:17.837966 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Id: bf922510f54d4d40ac00486394d67a7a Aug 24 07:43:17.837966 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1782416949 Aug 24 07:43:17.837966 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Role: reader,member Aug 24 07:43:17.837966 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Roles: reader,member Aug 24 07:43:17.839351 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bf922510f54d4d40ac00486394d67a7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bf922510f54d4d40ac00486394d67a7a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bf922510f54d4d40ac00486394d67a7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bf922510f54d4d40ac00486394d67a7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:43:17.839351 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant: tempest-VolumesSnapshotTestJSON-1782416949 Aug 24 07:43:17.839351 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Id: bf922510f54d4d40ac00486394d67a7a Aug 24 07:43:17.839351 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1782416949 Aug 24 07:43:17.839351 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User: tempest-VolumesSnapshotTestJSON-1782416949-project Aug 24 07:43:17.839351 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Id: default Aug 24 07:43:17.839351 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Name: Default Aug 24 07:43:17.839351 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Id: 74594b3982264446b73d14bad3f46045 Aug 24 07:43:17.839351 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Name: tempest-VolumesSnapshotTestJSON-1782416949-project Aug 24 07:43:17.839351 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: method: > Aug 24 07:43:17.839351 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: exception: Instance 7a4bf12e-c36e-425e-bd1f-181bd4326de3 could not be found. Aug 24 07:43:17.839351 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: action_args: {'id': '7a4bf12e-c36e-425e-bd1f-181bd4326de3'} Aug 24 07:43:17.840123 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:43:17.840123 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:43:17.840123 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:43:17.840123 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:43:17.840123 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:43:17.840123 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:43:17.840123 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:43:17.840123 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:43:17.840123 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:43:17.840123 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:43:17.840123 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a4bf12e-c36e-425e-bd1f-181bd4326de3 could not be found. Aug 24 07:43:17.840123 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:43:17.840123 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:43:17.840123 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:43:17.840123 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:43:17.840123 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:43:17.840123 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:43:17.840123 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:43:17.840123 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:43:17.840123 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:43:17.841398 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:43:17.841398 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 07:43:17.841398 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 07:43:17.841398 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:43:17.841398 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:43:17.841398 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:43:17.841398 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:43:17.841398 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a4bf12e-c36e-425e-bd1f-181bd4326de3 could not be found. Aug 24 07:43:17.841398 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:43:17.841398 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:43:17.841398 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:43:17.841398 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:43:17.841398 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:43:17.841398 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:43:17.841398 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:43:17.841398 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:43:17.841398 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a4bf12e-c36e-425e-bd1f-181bd4326de3 could not be found. Aug 24 07:43:17.841398 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:43:17.844812 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-b7ba34e2-2b6f-4cbb-8467-a417d39b3e37 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Returning 404 to user: Instance 7a4bf12e-c36e-425e-bd1f-181bd4326de3 could not be found. {{(pid=127113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:43:17.847546 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-b7ba34e2-2b6f-4cbb-8467-a417d39b3e37 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] 10.222.0.42 "GET /compute/v2.1/servers/7a4bf12e-c36e-425e-bd1f-181bd4326de3" status: 404 len: 111 microversion: 2.1 time: 0.064929 Aug 24 07:43:17.852717 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 196/402] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:17 2022] GET /compute/v2.1/servers/7a4bf12e-c36e-425e-bd1f-181bd4326de3 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:43:18.150115 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-bb3d4857-1b4e-459b-8117-c231a686a6c8 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:18.151363 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-bb3d4857-1b4e-459b-8117-c231a686a6c8 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 6f20697e-980b-4345-addc-d4907757ff37] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:18.174069 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-bb3d4857-1b4e-459b-8117-c231a686a6c8 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:18.175012 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-bb3d4857-1b4e-459b-8117-c231a686a6c8 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:18.175644 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [req-035dec57-defe-4227-b497-0126b5fd7109 req-19cac71a-0b47-410b-b220-25c60fd3d7a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b03f29f3-9610-46c2-908b-80a6029e29e7", "name": "network-vif-plugged", "status": "completed", "tag": "02d2e54e-1c33-4911-9c16-6aae2c1e3dbf"}]} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:43:18.178234 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-bb3d4857-1b4e-459b-8117-c231a686a6c8 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:18.179254 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-bb3d4857-1b4e-459b-8117-c231a686a6c8 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:18.180322 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-bb3d4857-1b4e-459b-8117-c231a686a6c8 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:18.187259 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-bb3d4857-1b4e-459b-8117-c231a686a6c8 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:18.215932 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-035dec57-defe-4227-b497-0126b5fd7109 req-19cac71a-0b47-410b-b220-25c60fd3d7a9 service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:18.216430 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-035dec57-defe-4227-b497-0126b5fd7109 req-19cac71a-0b47-410b-b220-25c60fd3d7a9 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:18.224309 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-035dec57-defe-4227-b497-0126b5fd7109 req-19cac71a-0b47-410b-b220-25c60fd3d7a9 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:18.257981 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.compute.server_external_events [req-035dec57-defe-4227-b497-0126b5fd7109 req-19cac71a-0b47-410b-b220-25c60fd3d7a9 service nova] Creating event network-vif-plugged:02d2e54e-1c33-4911-9c16-6aae2c1e3dbf for instance b03f29f3-9610-46c2-908b-80a6029e29e7 on hv-cinder-85427 Aug 24 07:43:18.281620 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [req-035dec57-defe-4227-b497-0126b5fd7109 req-19cac71a-0b47-410b-b220-25c60fd3d7a9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106775 Aug 24 07:43:18.285548 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 197/403] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:43:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:43:18.407255 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-ae814dec-0d4f-4932-8307-e0679e7fd343 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:18.407965 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-ae814dec-0d4f-4932-8307-e0679e7fd343 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: 851572e6-8dda-401b-aab8-58fbe54a2b31] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:18.424604 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ae814dec-0d4f-4932-8307-e0679e7fd343 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:18.428793 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ae814dec-0d4f-4932-8307-e0679e7fd343 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:18.429477 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ae814dec-0d4f-4932-8307-e0679e7fd343 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:18.431301 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ae814dec-0d4f-4932-8307-e0679e7fd343 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:18.436809 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ae814dec-0d4f-4932-8307-e0679e7fd343 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:18.437503 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ae814dec-0d4f-4932-8307-e0679e7fd343 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:18.608477 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-bb3d4857-1b4e-459b-8117-c231a686a6c8 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:18.633841 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-bb3d4857-1b4e-459b-8117-c231a686a6c8 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37" status: 200 len: 1266 microversion: 2.1 time: 0.487097 Aug 24 07:43:18.635496 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 207/404] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:18 2022] GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37 => generated 1266 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:18.791377 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-964cca3f-5e6d-42b8-ad26-a6e7372d1d85 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:18.792259 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-964cca3f-5e6d-42b8-ad26-a6e7372d1d85 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] [instance: b03f29f3-9610-46c2-908b-80a6029e29e7] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:18.798615 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-964cca3f-5e6d-42b8-ad26-a6e7372d1d85 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:18.799423 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-964cca3f-5e6d-42b8-ad26-a6e7372d1d85 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:18.800685 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-964cca3f-5e6d-42b8-ad26-a6e7372d1d85 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:18.801720 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-964cca3f-5e6d-42b8-ad26-a6e7372d1d85 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:18.802375 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-964cca3f-5e6d-42b8-ad26-a6e7372d1d85 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:18.805329 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-964cca3f-5e6d-42b8-ad26-a6e7372d1d85 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:18.908378 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-ae814dec-0d4f-4932-8307-e0679e7fd343 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:18.918870 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-ae814dec-0d4f-4932-8307-e0679e7fd343 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31" status: 200 len: 1366 microversion: 2.1 time: 0.520532 Aug 24 07:43:18.934164 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 198/405] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:18 2022] GET /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31 => generated 1366 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:19.048264 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-964cca3f-5e6d-42b8-ad26-a6e7372d1d85 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7963a259502456da3f2113e08557a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea75360af6084fa0a228bb86e711482a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:19.058863 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-964cca3f-5e6d-42b8-ad26-a6e7372d1d85 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] 10.222.0.42 "GET /compute/v2.1/servers/b03f29f3-9610-46c2-908b-80a6029e29e7" status: 200 len: 1314 microversion: 2.1 time: 0.273440 Aug 24 07:43:19.067118 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 208/406] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:18 2022] GET /compute/v2.1/servers/b03f29f3-9610-46c2-908b-80a6029e29e7 => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:19.465795 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [req-3ef7b2a6-e9be-48b5-bc08-1cb9be00e38a req-5199a9bf-5f84-4a7f-b33a-eb44bc08b555 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "851572e6-8dda-401b-aab8-58fbe54a2b31", "tag": "7aba0a71-3684-421c-8bb6-d7a57f843f6f"}]} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:43:19.471482 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:19.477572 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-3ef7b2a6-e9be-48b5-bc08-1cb9be00e38a req-5199a9bf-5f84-4a7f-b33a-eb44bc08b555 service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:19.478407 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-3ef7b2a6-e9be-48b5-bc08-1cb9be00e38a req-5199a9bf-5f84-4a7f-b33a-eb44bc08b555 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:19.478881 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-3ef7b2a6-e9be-48b5-bc08-1cb9be00e38a req-5199a9bf-5f84-4a7f-b33a-eb44bc08b555 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:19.492170 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.compute.server_external_events [req-3ef7b2a6-e9be-48b5-bc08-1cb9be00e38a req-5199a9bf-5f84-4a7f-b33a-eb44bc08b555 service nova] Creating event network-changed:7aba0a71-3684-421c-8bb6-d7a57f843f6f for instance 851572e6-8dda-401b-aab8-58fbe54a2b31 on hv-cinder-85427 Aug 24 07:43:19.498272 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [req-3ef7b2a6-e9be-48b5-bc08-1cb9be00e38a req-5199a9bf-5f84-4a7f-b33a-eb44bc08b555 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036001 Aug 24 07:43:19.499201 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 199/407] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:43:19.656496 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-b1bcf4bc-488e-41e2-8513-c530044bf379 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:19.657203 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-b1bcf4bc-488e-41e2-8513-c530044bf379 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 6f20697e-980b-4345-addc-d4907757ff37] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:19.663951 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b1bcf4bc-488e-41e2-8513-c530044bf379 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:19.664438 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b1bcf4bc-488e-41e2-8513-c530044bf379 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:19.664873 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b1bcf4bc-488e-41e2-8513-c530044bf379 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:19.665573 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b1bcf4bc-488e-41e2-8513-c530044bf379 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:19.666023 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b1bcf4bc-488e-41e2-8513-c530044bf379 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:19.666492 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b1bcf4bc-488e-41e2-8513-c530044bf379 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:19.825183 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-b1bcf4bc-488e-41e2-8513-c530044bf379 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:19.834188 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-b1bcf4bc-488e-41e2-8513-c530044bf379 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37" status: 200 len: 1266 microversion: 2.1 time: 0.181599 Aug 24 07:43:19.834801 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 209/408] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:19 2022] GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:19.941909 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-20edfd1a-495b-4e18-b3ab-ca57efc657c3 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:19.943010 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-20edfd1a-495b-4e18-b3ab-ca57efc657c3 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: 851572e6-8dda-401b-aab8-58fbe54a2b31] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:19.949808 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-20edfd1a-495b-4e18-b3ab-ca57efc657c3 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:19.950369 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-20edfd1a-495b-4e18-b3ab-ca57efc657c3 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:19.950890 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-20edfd1a-495b-4e18-b3ab-ca57efc657c3 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:19.951791 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-20edfd1a-495b-4e18-b3ab-ca57efc657c3 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:19.952446 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-20edfd1a-495b-4e18-b3ab-ca57efc657c3 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:19.952928 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-20edfd1a-495b-4e18-b3ab-ca57efc657c3 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:20.083859 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-9a7e125f-6422-4cf2-aafb-4a4491c5fc86 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:20.084935 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-9a7e125f-6422-4cf2-aafb-4a4491c5fc86 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] [instance: b03f29f3-9610-46c2-908b-80a6029e29e7] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:20.091204 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9a7e125f-6422-4cf2-aafb-4a4491c5fc86 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:20.091917 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9a7e125f-6422-4cf2-aafb-4a4491c5fc86 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:20.092520 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9a7e125f-6422-4cf2-aafb-4a4491c5fc86 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:20.093390 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9a7e125f-6422-4cf2-aafb-4a4491c5fc86 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:20.096398 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9a7e125f-6422-4cf2-aafb-4a4491c5fc86 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:20.097110 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9a7e125f-6422-4cf2-aafb-4a4491c5fc86 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:20.107067 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-20edfd1a-495b-4e18-b3ab-ca57efc657c3 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:20.115965 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-20edfd1a-495b-4e18-b3ab-ca57efc657c3 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31" status: 200 len: 1366 microversion: 2.1 time: 0.178262 Aug 24 07:43:20.116542 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 200/409] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:19 2022] GET /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31 => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:20.251241 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-9a7e125f-6422-4cf2-aafb-4a4491c5fc86 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7963a259502456da3f2113e08557a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea75360af6084fa0a228bb86e711482a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:20.261880 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-9a7e125f-6422-4cf2-aafb-4a4491c5fc86 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] 10.222.0.42 "GET /compute/v2.1/servers/b03f29f3-9610-46c2-908b-80a6029e29e7" status: 200 len: 1314 microversion: 2.1 time: 0.184465 Aug 24 07:43:20.262635 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 210/410] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:20 2022] GET /compute/v2.1/servers/b03f29f3-9610-46c2-908b-80a6029e29e7 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:43:20.859625 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-11e9994a-ac4d-46ea-af04-1a71e9200d4a tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:20.860909 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-11e9994a-ac4d-46ea-af04-1a71e9200d4a tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 6f20697e-980b-4345-addc-d4907757ff37] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:20.867942 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-11e9994a-ac4d-46ea-af04-1a71e9200d4a tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:20.868647 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-11e9994a-ac4d-46ea-af04-1a71e9200d4a tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:20.869327 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-11e9994a-ac4d-46ea-af04-1a71e9200d4a tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:20.870092 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-11e9994a-ac4d-46ea-af04-1a71e9200d4a tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:20.870805 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-11e9994a-ac4d-46ea-af04-1a71e9200d4a tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:20.871440 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-11e9994a-ac4d-46ea-af04-1a71e9200d4a tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:21.012273 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-11e9994a-ac4d-46ea-af04-1a71e9200d4a tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:21.020313 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-11e9994a-ac4d-46ea-af04-1a71e9200d4a tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37" status: 200 len: 1266 microversion: 2.1 time: 0.164559 Aug 24 07:43:21.021504 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 201/411] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:20 2022] GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:21.137278 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-7395251f-079f-49c7-b4da-1efa2219a733 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:21.138585 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-7395251f-079f-49c7-b4da-1efa2219a733 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: 851572e6-8dda-401b-aab8-58fbe54a2b31] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:21.144977 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7395251f-079f-49c7-b4da-1efa2219a733 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:21.145478 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7395251f-079f-49c7-b4da-1efa2219a733 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:21.145923 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7395251f-079f-49c7-b4da-1efa2219a733 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:21.146635 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7395251f-079f-49c7-b4da-1efa2219a733 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:21.147116 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7395251f-079f-49c7-b4da-1efa2219a733 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:21.147788 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7395251f-079f-49c7-b4da-1efa2219a733 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:21.282996 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-7c703bcc-7be0-45df-b349-89a7bfe4f645 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:21.283602 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-7c703bcc-7be0-45df-b349-89a7bfe4f645 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] [instance: b03f29f3-9610-46c2-908b-80a6029e29e7] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:21.293735 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-7395251f-079f-49c7-b4da-1efa2219a733 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:21.300006 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7c703bcc-7be0-45df-b349-89a7bfe4f645 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:21.300497 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7c703bcc-7be0-45df-b349-89a7bfe4f645 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:21.301033 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7c703bcc-7be0-45df-b349-89a7bfe4f645 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:21.301746 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7c703bcc-7be0-45df-b349-89a7bfe4f645 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:21.302198 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7c703bcc-7be0-45df-b349-89a7bfe4f645 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:21.302406 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-7395251f-079f-49c7-b4da-1efa2219a733 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31" status: 200 len: 1366 microversion: 2.1 time: 0.168879 Aug 24 07:43:21.302619 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7c703bcc-7be0-45df-b349-89a7bfe4f645 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:21.316098 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 211/412] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:21 2022] GET /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:21.454825 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-7c703bcc-7be0-45df-b349-89a7bfe4f645 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7963a259502456da3f2113e08557a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea75360af6084fa0a228bb86e711482a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:21.465699 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-7c703bcc-7be0-45df-b349-89a7bfe4f645 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] 10.222.0.42 "GET /compute/v2.1/servers/b03f29f3-9610-46c2-908b-80a6029e29e7" status: 200 len: 1314 microversion: 2.1 time: 0.186388 Aug 24 07:43:21.466278 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 202/413] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:21 2022] GET /compute/v2.1/servers/b03f29f3-9610-46c2-908b-80a6029e29e7 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:43:22.041351 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-f452aa2c-99e2-481a-ad44-f6c90e598974 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:22.042040 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-f452aa2c-99e2-481a-ad44-f6c90e598974 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 6f20697e-980b-4345-addc-d4907757ff37] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:22.045531 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell0:SELECT=2 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:22.045785 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell0:SELECT=8 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:22.057831 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f452aa2c-99e2-481a-ad44-f6c90e598974 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:22.058754 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f452aa2c-99e2-481a-ad44-f6c90e598974 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:22.059481 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f452aa2c-99e2-481a-ad44-f6c90e598974 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:22.060605 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f452aa2c-99e2-481a-ad44-f6c90e598974 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:22.061270 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f452aa2c-99e2-481a-ad44-f6c90e598974 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:22.061915 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f452aa2c-99e2-481a-ad44-f6c90e598974 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:22.300597 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-f452aa2c-99e2-481a-ad44-f6c90e598974 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:22.309166 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-f452aa2c-99e2-481a-ad44-f6c90e598974 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37" status: 200 len: 1266 microversion: 2.1 time: 0.271871 Aug 24 07:43:22.309729 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 212/414] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:22 2022] GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37 => generated 1266 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:22.327913 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-928aed92-b033-4257-844b-6005870ac42b tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:22.329120 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-928aed92-b033-4257-844b-6005870ac42b tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: 851572e6-8dda-401b-aab8-58fbe54a2b31] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:22.337000 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-928aed92-b033-4257-844b-6005870ac42b tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:22.337474 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-928aed92-b033-4257-844b-6005870ac42b tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:22.338014 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-928aed92-b033-4257-844b-6005870ac42b tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:22.338758 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-928aed92-b033-4257-844b-6005870ac42b tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:22.339379 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-928aed92-b033-4257-844b-6005870ac42b tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:22.339796 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-928aed92-b033-4257-844b-6005870ac42b tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:22.459854 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [req-6a2f492a-254e-44fc-9979-4bddcddef51b req-cd3b36ba-cfc8-4ee0-bc4e-023c1f42452e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f20697e-980b-4345-addc-d4907757ff37", "tag": "599f3399-205e-4f58-a04f-6a46a51e0c0e"}]} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:43:22.482300 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-6a2f492a-254e-44fc-9979-4bddcddef51b req-cd3b36ba-cfc8-4ee0-bc4e-023c1f42452e service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:22.483021 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-6a2f492a-254e-44fc-9979-4bddcddef51b req-cd3b36ba-cfc8-4ee0-bc4e-023c1f42452e service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:22.484450 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-6a2f492a-254e-44fc-9979-4bddcddef51b req-cd3b36ba-cfc8-4ee0-bc4e-023c1f42452e service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:22.519268 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.compute.server_external_events [req-6a2f492a-254e-44fc-9979-4bddcddef51b req-cd3b36ba-cfc8-4ee0-bc4e-023c1f42452e service nova] Creating event network-changed:599f3399-205e-4f58-a04f-6a46a51e0c0e for instance 6f20697e-980b-4345-addc-d4907757ff37 on hv-cinder-85427 Aug 24 07:43:22.528661 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [req-6a2f492a-254e-44fc-9979-4bddcddef51b req-cd3b36ba-cfc8-4ee0-bc4e-023c1f42452e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074045 Aug 24 07:43:22.529257 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 213/415] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:43:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:43:22.541203 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-1172ac5d-6617-4aac-a1d1-de535c78f43c tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:22.541884 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-1172ac5d-6617-4aac-a1d1-de535c78f43c tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] [instance: b03f29f3-9610-46c2-908b-80a6029e29e7] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:22.548771 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1172ac5d-6617-4aac-a1d1-de535c78f43c tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:22.549264 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1172ac5d-6617-4aac-a1d1-de535c78f43c tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:22.549725 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1172ac5d-6617-4aac-a1d1-de535c78f43c tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:22.550419 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1172ac5d-6617-4aac-a1d1-de535c78f43c tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:22.550965 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1172ac5d-6617-4aac-a1d1-de535c78f43c tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:22.551388 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1172ac5d-6617-4aac-a1d1-de535c78f43c tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:22.555893 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell1:SELECT=100 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:22.592962 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-928aed92-b033-4257-844b-6005870ac42b tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:22.599068 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:22.624494 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-928aed92-b033-4257-844b-6005870ac42b tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31" status: 200 len: 1366 microversion: 2.1 time: 0.300214 Aug 24 07:43:22.641111 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 203/416] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:22 2022] GET /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31 => generated 1366 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:22.860202 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-1172ac5d-6617-4aac-a1d1-de535c78f43c tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7963a259502456da3f2113e08557a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea75360af6084fa0a228bb86e711482a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:22.893690 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-1172ac5d-6617-4aac-a1d1-de535c78f43c tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] 10.222.0.42 "GET /compute/v2.1/servers/b03f29f3-9610-46c2-908b-80a6029e29e7" status: 200 len: 1314 microversion: 2.1 time: 0.354557 Aug 24 07:43:22.895914 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 214/417] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:22 2022] GET /compute/v2.1/servers/b03f29f3-9610-46c2-908b-80a6029e29e7 => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:23.333537 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-e9db2f5d-ac13-4ba9-9aff-f973fa3471eb tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:23.334128 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-e9db2f5d-ac13-4ba9-9aff-f973fa3471eb tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 6f20697e-980b-4345-addc-d4907757ff37] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:23.350484 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e9db2f5d-ac13-4ba9-9aff-f973fa3471eb tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:23.351590 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e9db2f5d-ac13-4ba9-9aff-f973fa3471eb tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:23.352341 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e9db2f5d-ac13-4ba9-9aff-f973fa3471eb tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:23.353574 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e9db2f5d-ac13-4ba9-9aff-f973fa3471eb tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:23.354464 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e9db2f5d-ac13-4ba9-9aff-f973fa3471eb tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:23.354966 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e9db2f5d-ac13-4ba9-9aff-f973fa3471eb tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:23.460482 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell0:SELECT=4 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:23.532357 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-e9db2f5d-ac13-4ba9-9aff-f973fa3471eb tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:23.548723 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-e9db2f5d-ac13-4ba9-9aff-f973fa3471eb tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37" status: 200 len: 1266 microversion: 2.1 time: 0.220663 Aug 24 07:43:23.551487 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 204/418] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:23 2022] GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37 => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:23.648802 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-e945b2be-7340-4373-813e-1d2fe1f31c27 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:23.650077 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-e945b2be-7340-4373-813e-1d2fe1f31c27 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: 851572e6-8dda-401b-aab8-58fbe54a2b31] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:23.656903 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e945b2be-7340-4373-813e-1d2fe1f31c27 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:23.657392 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e945b2be-7340-4373-813e-1d2fe1f31c27 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:23.657826 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e945b2be-7340-4373-813e-1d2fe1f31c27 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:23.667458 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e945b2be-7340-4373-813e-1d2fe1f31c27 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:23.668224 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e945b2be-7340-4373-813e-1d2fe1f31c27 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:23.668844 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e945b2be-7340-4373-813e-1d2fe1f31c27 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:23.915947 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-41b8dc5d-2581-4385-8f69-bf36fd9af5ef tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:23.916577 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-41b8dc5d-2581-4385-8f69-bf36fd9af5ef tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] [instance: b03f29f3-9610-46c2-908b-80a6029e29e7] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:23.929466 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell0:SELECT=20 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:23.938443 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-41b8dc5d-2581-4385-8f69-bf36fd9af5ef tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:23.949267 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-41b8dc5d-2581-4385-8f69-bf36fd9af5ef tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:23.953353 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-41b8dc5d-2581-4385-8f69-bf36fd9af5ef tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:23.954285 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-41b8dc5d-2581-4385-8f69-bf36fd9af5ef tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:23.955268 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-41b8dc5d-2581-4385-8f69-bf36fd9af5ef tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:23.963570 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-41b8dc5d-2581-4385-8f69-bf36fd9af5ef tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:24.226119 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-41b8dc5d-2581-4385-8f69-bf36fd9af5ef tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7963a259502456da3f2113e08557a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea75360af6084fa0a228bb86e711482a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:24.233856 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-41b8dc5d-2581-4385-8f69-bf36fd9af5ef tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] 10.222.0.42 "GET /compute/v2.1/servers/b03f29f3-9610-46c2-908b-80a6029e29e7" status: 200 len: 1463 microversion: 2.1 time: 0.321755 Aug 24 07:43:24.246915 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 205/419] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:23 2022] GET /compute/v2.1/servers/b03f29f3-9610-46c2-908b-80a6029e29e7 => generated 1463 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:24.246915 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-c0e3a25a-3e8e-4db7-93cf-3352656ea92a tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:24.246915 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-c0e3a25a-3e8e-4db7-93cf-3352656ea92a tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:24.246915 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c0e3a25a-3e8e-4db7-93cf-3352656ea92a tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:24.247386 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c0e3a25a-3e8e-4db7-93cf-3352656ea92a tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:24.247386 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c0e3a25a-3e8e-4db7-93cf-3352656ea92a tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:24.247386 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c0e3a25a-3e8e-4db7-93cf-3352656ea92a tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:24.247802 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c0e3a25a-3e8e-4db7-93cf-3352656ea92a tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:24.248220 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c0e3a25a-3e8e-4db7-93cf-3352656ea92a tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:24.295576 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-e945b2be-7340-4373-813e-1d2fe1f31c27 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:24.304836 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-e945b2be-7340-4373-813e-1d2fe1f31c27 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31" status: 200 len: 1366 microversion: 2.1 time: 0.659786 Aug 24 07:43:24.305408 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 215/420] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:23 2022] GET /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31 => generated 1366 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:24.311274 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-42674194-168d-46f6-a516-ae606775f3fd tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:24.312294 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-42674194-168d-46f6-a516-ae606775f3fd tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] [instance: b03f29f3-9610-46c2-908b-80a6029e29e7] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:24.319568 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-42674194-168d-46f6-a516-ae606775f3fd tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:24.320449 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-42674194-168d-46f6-a516-ae606775f3fd tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:24.321053 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-42674194-168d-46f6-a516-ae606775f3fd tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:24.321780 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-42674194-168d-46f6-a516-ae606775f3fd tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:24.322228 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-42674194-168d-46f6-a516-ae606775f3fd tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:24.322721 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-42674194-168d-46f6-a516-ae606775f3fd tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:24.356817 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-42674194-168d-46f6-a516-ae606775f3fd tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] [instance: b03f29f3-9610-46c2-908b-80a6029e29e7] Going to try to terminate instance {{(pid=127114) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 07:43:24.357314 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.objects.instance [None req-c0e3a25a-3e8e-4db7-93cf-3352656ea92a tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lazy-loading 'services' on Instance uuid 63a5cb56-fccf-4fbe-be10-b637c616539c {{(pid=127113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:43:24.444004 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-c0e3a25a-3e8e-4db7-93cf-3352656ea92a tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "DELETE /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c/os-volume_attachments/a82f9834-0f0f-406e-8263-658914370081" status: 202 len: 0 microversion: 2.1 time: 0.208181 Aug 24 07:43:24.444858 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 206/421] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Aug 24 07:43:24 2022] DELETE /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c/os-volume_attachments/a82f9834-0f0f-406e-8263-658914370081 => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 07:43:24.445474 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-42674194-168d-46f6-a516-ae606775f3fd tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b03f29f3-9610-46c2-908b-80a6029e29e7" status: 204 len: 0 microversion: 2.1 time: 0.137422 Aug 24 07:43:24.446209 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 216/422] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 24 07:43:24 2022] DELETE /compute/v2.1/servers/b03f29f3-9610-46c2-908b-80a6029e29e7 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 07:43:24.454614 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-25d45430-841c-4a6a-b26d-12ae44f21f6f tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:24.456020 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-25d45430-841c-4a6a-b26d-12ae44f21f6f tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] [instance: b03f29f3-9610-46c2-908b-80a6029e29e7] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:24.463734 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-25d45430-841c-4a6a-b26d-12ae44f21f6f tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:24.464207 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-25d45430-841c-4a6a-b26d-12ae44f21f6f tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:24.464629 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-25d45430-841c-4a6a-b26d-12ae44f21f6f tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:24.465307 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-25d45430-841c-4a6a-b26d-12ae44f21f6f tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:24.465748 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-25d45430-841c-4a6a-b26d-12ae44f21f6f tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:24.466161 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-25d45430-841c-4a6a-b26d-12ae44f21f6f tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:24.572379 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-f18a860f-a08a-472e-b731-89a1cfe69c25 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:24.573067 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-f18a860f-a08a-472e-b731-89a1cfe69c25 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 6f20697e-980b-4345-addc-d4907757ff37] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:24.578955 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f18a860f-a08a-472e-b731-89a1cfe69c25 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:24.579897 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f18a860f-a08a-472e-b731-89a1cfe69c25 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:24.579897 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f18a860f-a08a-472e-b731-89a1cfe69c25 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:24.581070 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f18a860f-a08a-472e-b731-89a1cfe69c25 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:24.581524 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f18a860f-a08a-472e-b731-89a1cfe69c25 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:24.581941 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f18a860f-a08a-472e-b731-89a1cfe69c25 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:24.598801 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-25d45430-841c-4a6a-b26d-12ae44f21f6f tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7963a259502456da3f2113e08557a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea75360af6084fa0a228bb86e711482a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:24.606562 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-25d45430-841c-4a6a-b26d-12ae44f21f6f tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] 10.222.0.42 "GET /compute/v2.1/servers/b03f29f3-9610-46c2-908b-80a6029e29e7" status: 200 len: 1469 microversion: 2.1 time: 0.156186 Aug 24 07:43:24.607166 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 207/423] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:24 2022] GET /compute/v2.1/servers/b03f29f3-9610-46c2-908b-80a6029e29e7 => generated 1469 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:24.710217 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-f18a860f-a08a-472e-b731-89a1cfe69c25 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:24.717693 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-f18a860f-a08a-472e-b731-89a1cfe69c25 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37" status: 200 len: 1266 microversion: 2.1 time: 0.149621 Aug 24 07:43:24.718251 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 217/424] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:24 2022] GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:43:25.325607 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-3e128005-eb81-4125-84d4-ab367b33692d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:25.326165 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-3e128005-eb81-4125-84d4-ab367b33692d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: 851572e6-8dda-401b-aab8-58fbe54a2b31] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:25.332625 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3e128005-eb81-4125-84d4-ab367b33692d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:25.333096 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3e128005-eb81-4125-84d4-ab367b33692d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:25.333526 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3e128005-eb81-4125-84d4-ab367b33692d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:25.334206 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3e128005-eb81-4125-84d4-ab367b33692d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:25.334655 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3e128005-eb81-4125-84d4-ab367b33692d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:25.335099 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3e128005-eb81-4125-84d4-ab367b33692d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:25.462361 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-3e128005-eb81-4125-84d4-ab367b33692d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:25.469860 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-3e128005-eb81-4125-84d4-ab367b33692d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31" status: 200 len: 1366 microversion: 2.1 time: 0.148150 Aug 24 07:43:25.470417 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 208/425] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:25 2022] GET /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:25.628895 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-ef799db0-fa07-4d80-8211-0d2d70b46d0a tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:25.629639 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-ef799db0-fa07-4d80-8211-0d2d70b46d0a tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] [instance: b03f29f3-9610-46c2-908b-80a6029e29e7] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:25.635897 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ef799db0-fa07-4d80-8211-0d2d70b46d0a tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:25.636408 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ef799db0-fa07-4d80-8211-0d2d70b46d0a tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:25.636846 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ef799db0-fa07-4d80-8211-0d2d70b46d0a tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:25.637533 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ef799db0-fa07-4d80-8211-0d2d70b46d0a tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:25.638014 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ef799db0-fa07-4d80-8211-0d2d70b46d0a tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:25.638436 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ef799db0-fa07-4d80-8211-0d2d70b46d0a tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:25.738080 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-562bd1f8-e06e-4600-a6ed-8b1ad80fef1d tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:25.738788 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-562bd1f8-e06e-4600-a6ed-8b1ad80fef1d tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 6f20697e-980b-4345-addc-d4907757ff37] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:25.744941 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-562bd1f8-e06e-4600-a6ed-8b1ad80fef1d tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:25.745452 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-562bd1f8-e06e-4600-a6ed-8b1ad80fef1d tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:25.745889 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-562bd1f8-e06e-4600-a6ed-8b1ad80fef1d tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:25.746584 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-562bd1f8-e06e-4600-a6ed-8b1ad80fef1d tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:25.747075 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-562bd1f8-e06e-4600-a6ed-8b1ad80fef1d tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:25.747501 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-562bd1f8-e06e-4600-a6ed-8b1ad80fef1d tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:25.764643 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-ef799db0-fa07-4d80-8211-0d2d70b46d0a tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7963a259502456da3f2113e08557a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea75360af6084fa0a228bb86e711482a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:25.773832 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-ef799db0-fa07-4d80-8211-0d2d70b46d0a tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] 10.222.0.42 "GET /compute/v2.1/servers/b03f29f3-9610-46c2-908b-80a6029e29e7" status: 200 len: 1469 microversion: 2.1 time: 0.149417 Aug 24 07:43:25.774398 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 218/426] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:25 2022] GET /compute/v2.1/servers/b03f29f3-9610-46c2-908b-80a6029e29e7 => generated 1469 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:25.874901 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-562bd1f8-e06e-4600-a6ed-8b1ad80fef1d tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:25.882468 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-562bd1f8-e06e-4600-a6ed-8b1ad80fef1d tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37" status: 200 len: 1266 microversion: 2.1 time: 0.149050 Aug 24 07:43:25.883062 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 209/427] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:25 2022] GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:43:26.489990 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-8660b263-5f5b-4124-af59-fe9dbb770829 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:26.490631 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-8660b263-5f5b-4124-af59-fe9dbb770829 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: 851572e6-8dda-401b-aab8-58fbe54a2b31] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:26.496636 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8660b263-5f5b-4124-af59-fe9dbb770829 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:26.497120 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8660b263-5f5b-4124-af59-fe9dbb770829 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:26.497556 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8660b263-5f5b-4124-af59-fe9dbb770829 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:26.498246 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8660b263-5f5b-4124-af59-fe9dbb770829 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:26.498712 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8660b263-5f5b-4124-af59-fe9dbb770829 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:26.499149 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8660b263-5f5b-4124-af59-fe9dbb770829 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:26.635523 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-8660b263-5f5b-4124-af59-fe9dbb770829 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:26.643066 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-8660b263-5f5b-4124-af59-fe9dbb770829 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31" status: 200 len: 1366 microversion: 2.1 time: 0.157580 Aug 24 07:43:26.643637 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 219/428] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:26 2022] GET /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:26.794420 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-841052b5-e477-43d5-ad10-8fbadb067957 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:26.795000 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-841052b5-e477-43d5-ad10-8fbadb067957 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] [instance: b03f29f3-9610-46c2-908b-80a6029e29e7] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:26.801756 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-841052b5-e477-43d5-ad10-8fbadb067957 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:26.802223 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-841052b5-e477-43d5-ad10-8fbadb067957 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:26.802647 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-841052b5-e477-43d5-ad10-8fbadb067957 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:26.803338 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-841052b5-e477-43d5-ad10-8fbadb067957 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:26.803779 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-841052b5-e477-43d5-ad10-8fbadb067957 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:26.804188 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-841052b5-e477-43d5-ad10-8fbadb067957 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:26.903188 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-a3ea9637-38ed-405c-acb4-5ed78be4b25b tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:26.903989 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-a3ea9637-38ed-405c-acb4-5ed78be4b25b tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 6f20697e-980b-4345-addc-d4907757ff37] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:26.910458 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a3ea9637-38ed-405c-acb4-5ed78be4b25b tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:26.911074 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a3ea9637-38ed-405c-acb4-5ed78be4b25b tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:26.911561 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a3ea9637-38ed-405c-acb4-5ed78be4b25b tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:26.912322 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a3ea9637-38ed-405c-acb4-5ed78be4b25b tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:26.912854 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a3ea9637-38ed-405c-acb4-5ed78be4b25b tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:26.913345 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a3ea9637-38ed-405c-acb4-5ed78be4b25b tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:26.929474 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-841052b5-e477-43d5-ad10-8fbadb067957 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7963a259502456da3f2113e08557a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea75360af6084fa0a228bb86e711482a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:26.937197 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-841052b5-e477-43d5-ad10-8fbadb067957 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] 10.222.0.42 "GET /compute/v2.1/servers/b03f29f3-9610-46c2-908b-80a6029e29e7" status: 200 len: 1469 microversion: 2.1 time: 0.146604 Aug 24 07:43:26.937749 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 210/429] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:26 2022] GET /compute/v2.1/servers/b03f29f3-9610-46c2-908b-80a6029e29e7 => generated 1469 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:27.040229 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-a3ea9637-38ed-405c-acb4-5ed78be4b25b tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:27.047827 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-a3ea9637-38ed-405c-acb4-5ed78be4b25b tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37" status: 200 len: 1266 microversion: 2.1 time: 0.148489 Aug 24 07:43:27.048331 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 220/430] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:26 2022] GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:27.663231 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-f91fba2a-32d5-4c83-88b5-7f023fc2e6e5 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:27.664003 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-f91fba2a-32d5-4c83-88b5-7f023fc2e6e5 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: 851572e6-8dda-401b-aab8-58fbe54a2b31] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:27.669847 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f91fba2a-32d5-4c83-88b5-7f023fc2e6e5 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:27.670320 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f91fba2a-32d5-4c83-88b5-7f023fc2e6e5 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:27.670780 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f91fba2a-32d5-4c83-88b5-7f023fc2e6e5 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:27.671457 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f91fba2a-32d5-4c83-88b5-7f023fc2e6e5 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:27.671900 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f91fba2a-32d5-4c83-88b5-7f023fc2e6e5 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:27.672315 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f91fba2a-32d5-4c83-88b5-7f023fc2e6e5 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:27.799889 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-f91fba2a-32d5-4c83-88b5-7f023fc2e6e5 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:27.808040 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-f91fba2a-32d5-4c83-88b5-7f023fc2e6e5 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31" status: 200 len: 1366 microversion: 2.1 time: 0.148536 Aug 24 07:43:27.808588 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 211/431] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:27 2022] GET /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:27.957441 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-302a951a-99de-41a1-b5f8-a892da49901b tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:27.958051 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-302a951a-99de-41a1-b5f8-a892da49901b tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] [instance: b03f29f3-9610-46c2-908b-80a6029e29e7] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:27.964511 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-302a951a-99de-41a1-b5f8-a892da49901b tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:27.964990 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-302a951a-99de-41a1-b5f8-a892da49901b tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:27.965423 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-302a951a-99de-41a1-b5f8-a892da49901b tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:27.966101 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-302a951a-99de-41a1-b5f8-a892da49901b tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:27.966550 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-302a951a-99de-41a1-b5f8-a892da49901b tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:27.967006 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-302a951a-99de-41a1-b5f8-a892da49901b tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:28.068750 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-af2802e2-d34c-445d-a502-c277c73ee69b tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:28.069351 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-af2802e2-d34c-445d-a502-c277c73ee69b tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 6f20697e-980b-4345-addc-d4907757ff37] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:28.076050 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-af2802e2-d34c-445d-a502-c277c73ee69b tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:28.076545 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-af2802e2-d34c-445d-a502-c277c73ee69b tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:28.077283 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-af2802e2-d34c-445d-a502-c277c73ee69b tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:28.078036 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-af2802e2-d34c-445d-a502-c277c73ee69b tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:28.078489 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-af2802e2-d34c-445d-a502-c277c73ee69b tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:28.078929 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-af2802e2-d34c-445d-a502-c277c73ee69b tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:28.098505 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-302a951a-99de-41a1-b5f8-a892da49901b tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7963a259502456da3f2113e08557a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea75360af6084fa0a228bb86e711482a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:28.106047 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-302a951a-99de-41a1-b5f8-a892da49901b tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] 10.222.0.42 "GET /compute/v2.1/servers/b03f29f3-9610-46c2-908b-80a6029e29e7" status: 200 len: 1469 microversion: 2.1 time: 0.152561 Aug 24 07:43:28.106609 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 221/432] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:27 2022] GET /compute/v2.1/servers/b03f29f3-9610-46c2-908b-80a6029e29e7 => generated 1469 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:28.223132 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-af2802e2-d34c-445d-a502-c277c73ee69b tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:28.230754 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-af2802e2-d34c-445d-a502-c277c73ee69b tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37" status: 200 len: 1266 microversion: 2.1 time: 0.165643 Aug 24 07:43:28.231601 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 212/433] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:28 2022] GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:43:28.271159 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-6642c556-6333-46f7-b255-540128585b66 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-243290089", "imageRef": "4358f547-a499-43f3-9c84-925d78cd73db", "flavorRef": "452", "networks": [{"uuid": "eed16aaf-1747-457e-8889-b3a6b4424d00"}]}} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:43:28.326884 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.network.neutron [None req-6642c556-6333-46f7-b255-540128585b66 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] validate_networks() for [('eed16aaf-1747-457e-8889-b3a6b4424d00', None, None, None, None, None)] {{(pid=127114) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 07:43:28.688089 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-6642c556-6333-46f7-b255-540128585b66 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Flavor limits 0:0:0 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 07:43:28.688504 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-6642c556-6333-46f7-b255-540128585b66 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Image limits 0:0:0 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 07:43:28.688971 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-6642c556-6333-46f7-b255-540128585b66 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Flavor pref 0:0:0 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 07:43:28.689399 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-6642c556-6333-46f7-b255-540128585b66 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Image pref 0:0:0 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 07:43:28.690347 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-6642c556-6333-46f7-b255-540128585b66 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 07:43:28.699693 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6642c556-6333-46f7-b255-540128585b66 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:28.700173 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6642c556-6333-46f7-b255-540128585b66 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:28.700604 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6642c556-6333-46f7-b255-540128585b66 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:28.701399 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6642c556-6333-46f7-b255-540128585b66 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:28.701831 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6642c556-6333-46f7-b255-540128585b66 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:28.702251 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6642c556-6333-46f7-b255-540128585b66 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:28.721498 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.quota [None req-6642c556-6333-46f7-b255-540128585b66 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Getting quotas for project bf922510f54d4d40ac00486394d67a7a. Resources: {'cores', 'ram', 'instances'} {{(pid=127114) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:43:28.725743 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.quota [None req-6642c556-6333-46f7-b255-540128585b66 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Getting quotas for user 74594b3982264446b73d14bad3f46045 and project bf922510f54d4d40ac00486394d67a7a. Resources: {'cores', 'ram', 'instances'} {{(pid=127114) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:43:28.737901 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-6642c556-6333-46f7-b255-540128585b66 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Going to run 1 instances... {{(pid=127114) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 07:43:28.740792 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-6642c556-6333-46f7-b255-540128585b66 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] [instance: 6821366f-ec0b-431d-86ef-393f5b0f728f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4358f547-a499-43f3-9c84-925d78cd73db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127114) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 07:43:28.790231 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-6642c556-6333-46f7-b255-540128585b66 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.525618 Aug 24 07:43:28.790903 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 222/434] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 24 07:43:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 07:43:28.801955 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-27452ba6-0509-4a40-ae67-daa3fe87e907 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:28.802555 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-27452ba6-0509-4a40-ae67-daa3fe87e907 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] [instance: 6821366f-ec0b-431d-86ef-393f5b0f728f] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:28.828713 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-a334b011-dff3-47e9-a5a0-d16d8976742d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:28.829415 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-a334b011-dff3-47e9-a5a0-d16d8976742d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: 851572e6-8dda-401b-aab8-58fbe54a2b31] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:28.836411 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a334b011-dff3-47e9-a5a0-d16d8976742d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:28.837152 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a334b011-dff3-47e9-a5a0-d16d8976742d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:28.837654 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a334b011-dff3-47e9-a5a0-d16d8976742d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:28.838428 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a334b011-dff3-47e9-a5a0-d16d8976742d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:28.838972 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a334b011-dff3-47e9-a5a0-d16d8976742d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:28.839464 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a334b011-dff3-47e9-a5a0-d16d8976742d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:28.856023 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-27452ba6-0509-4a40-ae67-daa3fe87e907 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74594b3982264446b73d14bad3f46045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf922510f54d4d40ac00486394d67a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:28.863711 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-27452ba6-0509-4a40-ae67-daa3fe87e907 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] 10.222.0.42 "GET /compute/v2.1/servers/6821366f-ec0b-431d-86ef-393f5b0f728f" status: 200 len: 1218 microversion: 2.1 time: 0.066002 Aug 24 07:43:28.864271 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 213/435] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:28 2022] GET /compute/v2.1/servers/6821366f-ec0b-431d-86ef-393f5b0f728f => generated 1218 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:28.980695 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-a334b011-dff3-47e9-a5a0-d16d8976742d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:28.989583 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-a334b011-dff3-47e9-a5a0-d16d8976742d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31" status: 200 len: 1366 microversion: 2.1 time: 0.165055 Aug 24 07:43:28.990138 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 223/436] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:28 2022] GET /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:43:29.127809 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-36301efc-af96-45ec-ba1b-13b10bac34e5 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:29.128412 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-36301efc-af96-45ec-ba1b-13b10bac34e5 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] [instance: b03f29f3-9610-46c2-908b-80a6029e29e7] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:29.134305 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-36301efc-af96-45ec-ba1b-13b10bac34e5 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:29.134814 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-36301efc-af96-45ec-ba1b-13b10bac34e5 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:29.135243 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-36301efc-af96-45ec-ba1b-13b10bac34e5 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:29.135993 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-36301efc-af96-45ec-ba1b-13b10bac34e5 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:29.136392 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-36301efc-af96-45ec-ba1b-13b10bac34e5 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:29.136743 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-36301efc-af96-45ec-ba1b-13b10bac34e5 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:29.251656 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-e85403ec-8089-4dcc-b515-8af93007620c tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:29.252246 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-e85403ec-8089-4dcc-b515-8af93007620c tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 6f20697e-980b-4345-addc-d4907757ff37] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:29.258112 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e85403ec-8089-4dcc-b515-8af93007620c tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:29.258585 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e85403ec-8089-4dcc-b515-8af93007620c tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:29.259051 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e85403ec-8089-4dcc-b515-8af93007620c tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:29.259736 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e85403ec-8089-4dcc-b515-8af93007620c tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:29.260183 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e85403ec-8089-4dcc-b515-8af93007620c tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:29.260595 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e85403ec-8089-4dcc-b515-8af93007620c tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:29.275670 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-36301efc-af96-45ec-ba1b-13b10bac34e5 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7963a259502456da3f2113e08557a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea75360af6084fa0a228bb86e711482a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:29.283836 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-36301efc-af96-45ec-ba1b-13b10bac34e5 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] 10.222.0.42 "GET /compute/v2.1/servers/b03f29f3-9610-46c2-908b-80a6029e29e7" status: 200 len: 1469 microversion: 2.1 time: 0.160440 Aug 24 07:43:29.284467 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 214/437] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:29 2022] GET /compute/v2.1/servers/b03f29f3-9610-46c2-908b-80a6029e29e7 => generated 1469 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:29.391806 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-e85403ec-8089-4dcc-b515-8af93007620c tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:29.399367 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-e85403ec-8089-4dcc-b515-8af93007620c tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37" status: 200 len: 1266 microversion: 2.1 time: 0.151627 Aug 24 07:43:29.399924 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 224/438] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:29 2022] GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:43:29.883822 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-3b717f15-deef-4bfe-8ece-0badb6e7da7a tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:29.895526 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-3b717f15-deef-4bfe-8ece-0badb6e7da7a tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] [instance: 6821366f-ec0b-431d-86ef-393f5b0f728f] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:29.901933 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3b717f15-deef-4bfe-8ece-0badb6e7da7a tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:29.903482 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3b717f15-deef-4bfe-8ece-0badb6e7da7a tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:29.904096 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3b717f15-deef-4bfe-8ece-0badb6e7da7a tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:29.904962 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3b717f15-deef-4bfe-8ece-0badb6e7da7a tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:29.905568 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3b717f15-deef-4bfe-8ece-0badb6e7da7a tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:29.906162 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3b717f15-deef-4bfe-8ece-0badb6e7da7a tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:29.994537 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-3b717f15-deef-4bfe-8ece-0badb6e7da7a tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74594b3982264446b73d14bad3f46045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf922510f54d4d40ac00486394d67a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:30.002650 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-3b717f15-deef-4bfe-8ece-0badb6e7da7a tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] 10.222.0.42 "GET /compute/v2.1/servers/6821366f-ec0b-431d-86ef-393f5b0f728f" status: 200 len: 1222 microversion: 2.1 time: 0.122084 Aug 24 07:43:30.003335 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 215/439] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:29 2022] GET /compute/v2.1/servers/6821366f-ec0b-431d-86ef-393f5b0f728f => generated 1222 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:30.011356 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-f30bf23e-0062-4253-8900-4a2c45f03d66 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:30.012133 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-f30bf23e-0062-4253-8900-4a2c45f03d66 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: 851572e6-8dda-401b-aab8-58fbe54a2b31] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:30.020019 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f30bf23e-0062-4253-8900-4a2c45f03d66 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:30.020580 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f30bf23e-0062-4253-8900-4a2c45f03d66 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:30.021016 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f30bf23e-0062-4253-8900-4a2c45f03d66 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:30.021737 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f30bf23e-0062-4253-8900-4a2c45f03d66 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:30.022177 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f30bf23e-0062-4253-8900-4a2c45f03d66 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:30.022751 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f30bf23e-0062-4253-8900-4a2c45f03d66 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:30.244403 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-f30bf23e-0062-4253-8900-4a2c45f03d66 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:30.252624 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-f30bf23e-0062-4253-8900-4a2c45f03d66 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31" status: 200 len: 1366 microversion: 2.1 time: 0.244714 Aug 24 07:43:30.253213 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 225/440] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:30 2022] GET /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31 => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:30.305259 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-088cff51-eb1f-410e-b923-ce65afe0ced4 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:30.306505 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-088cff51-eb1f-410e-b923-ce65afe0ced4 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] [instance: b03f29f3-9610-46c2-908b-80a6029e29e7] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:30.312872 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-088cff51-eb1f-410e-b923-ce65afe0ced4 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:30.313552 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-088cff51-eb1f-410e-b923-ce65afe0ced4 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:30.314190 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-088cff51-eb1f-410e-b923-ce65afe0ced4 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:30.315684 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-088cff51-eb1f-410e-b923-ce65afe0ced4 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:30.316462 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-088cff51-eb1f-410e-b923-ce65afe0ced4 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:30.317076 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-088cff51-eb1f-410e-b923-ce65afe0ced4 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:30.420001 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-15486973-4a09-4e7b-816b-2828ebe087c9 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:30.420607 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-15486973-4a09-4e7b-816b-2828ebe087c9 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 6f20697e-980b-4345-addc-d4907757ff37] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:30.432341 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-15486973-4a09-4e7b-816b-2828ebe087c9 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:30.432829 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-15486973-4a09-4e7b-816b-2828ebe087c9 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:30.435563 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-15486973-4a09-4e7b-816b-2828ebe087c9 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:30.436497 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-15486973-4a09-4e7b-816b-2828ebe087c9 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:30.440297 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-15486973-4a09-4e7b-816b-2828ebe087c9 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:30.442107 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-15486973-4a09-4e7b-816b-2828ebe087c9 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:30.517277 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-088cff51-eb1f-410e-b923-ce65afe0ced4 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7963a259502456da3f2113e08557a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea75360af6084fa0a228bb86e711482a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:30.528786 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-088cff51-eb1f-410e-b923-ce65afe0ced4 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] 10.222.0.42 "GET /compute/v2.1/servers/b03f29f3-9610-46c2-908b-80a6029e29e7" status: 200 len: 1469 microversion: 2.1 time: 0.226044 Aug 24 07:43:30.531038 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 216/441] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:30 2022] GET /compute/v2.1/servers/b03f29f3-9610-46c2-908b-80a6029e29e7 => generated 1469 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:30.701839 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-15486973-4a09-4e7b-816b-2828ebe087c9 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:30.712454 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-15486973-4a09-4e7b-816b-2828ebe087c9 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37" status: 200 len: 1266 microversion: 2.1 time: 0.295839 Aug 24 07:43:30.713046 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 226/442] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:30 2022] GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37 => generated 1266 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:43:30.920464 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-e0ce29b3-2ce8-456a-9046-1de1fc35678a tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:43:30.935647 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e0ce29b3-2ce8-456a-9046-1de1fc35678a tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:30.936739 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e0ce29b3-2ce8-456a-9046-1de1fc35678a tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:30.938329 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e0ce29b3-2ce8-456a-9046-1de1fc35678a tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:31.008882 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-e0ce29b3-2ce8-456a-9046-1de1fc35678a tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Going to try to stop instance {{(pid=127113) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 07:43:31.025604 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-24c2c810-d134-4834-b950-d049b01432dc tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:31.027124 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-24c2c810-d134-4834-b950-d049b01432dc tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] [instance: 6821366f-ec0b-431d-86ef-393f5b0f728f] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:31.039238 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-24c2c810-d134-4834-b950-d049b01432dc tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:31.039862 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-24c2c810-d134-4834-b950-d049b01432dc tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:31.040505 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-24c2c810-d134-4834-b950-d049b01432dc tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:31.045634 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-24c2c810-d134-4834-b950-d049b01432dc tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:31.046166 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-24c2c810-d134-4834-b950-d049b01432dc tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:31.046588 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-24c2c810-d134-4834-b950-d049b01432dc tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:31.089456 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-e0ce29b3-2ce8-456a-9046-1de1fc35678a tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "POST /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c/action" status: 202 len: 0 microversion: 2.1 time: 0.174314 Aug 24 07:43:31.094096 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 217/443] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 24 07:43:30 2022] POST /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 07:43:31.102955 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-bd477127-9dc2-4c0b-aa27-890802e91828 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:31.104546 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-bd477127-9dc2-4c0b-aa27-890802e91828 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:31.113100 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bd477127-9dc2-4c0b-aa27-890802e91828 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:31.113739 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bd477127-9dc2-4c0b-aa27-890802e91828 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:31.115142 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bd477127-9dc2-4c0b-aa27-890802e91828 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:31.117375 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bd477127-9dc2-4c0b-aa27-890802e91828 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:31.118038 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bd477127-9dc2-4c0b-aa27-890802e91828 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:31.118656 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bd477127-9dc2-4c0b-aa27-890802e91828 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:31.169502 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-24c2c810-d134-4834-b950-d049b01432dc tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74594b3982264446b73d14bad3f46045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf922510f54d4d40ac00486394d67a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:31.182443 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-24c2c810-d134-4834-b950-d049b01432dc tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] 10.222.0.42 "GET /compute/v2.1/servers/6821366f-ec0b-431d-86ef-393f5b0f728f" status: 200 len: 1270 microversion: 2.1 time: 0.160918 Aug 24 07:43:31.183493 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 227/444] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:31 2022] GET /compute/v2.1/servers/6821366f-ec0b-431d-86ef-393f5b0f728f => generated 1270 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:31.190090 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [req-6f4cf2ac-662f-4784-994e-22a80db56c03 req-729ee11b-4314-43ac-8344-a243591814fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b03f29f3-9610-46c2-908b-80a6029e29e7", "name": "network-vif-deleted", "tag": "02d2e54e-1c33-4911-9c16-6aae2c1e3dbf"}]} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:43:31.203826 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-6f4cf2ac-662f-4784-994e-22a80db56c03 req-729ee11b-4314-43ac-8344-a243591814fb service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:31.204379 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-6f4cf2ac-662f-4784-994e-22a80db56c03 req-729ee11b-4314-43ac-8344-a243591814fb service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:31.205576 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-6f4cf2ac-662f-4784-994e-22a80db56c03 req-729ee11b-4314-43ac-8344-a243591814fb service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:31.221173 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.compute.server_external_events [req-6f4cf2ac-662f-4784-994e-22a80db56c03 req-729ee11b-4314-43ac-8344-a243591814fb service nova] Creating event network-vif-deleted:02d2e54e-1c33-4911-9c16-6aae2c1e3dbf for instance b03f29f3-9610-46c2-908b-80a6029e29e7 on hv-cinder-85427 Aug 24 07:43:31.227458 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [req-6f4cf2ac-662f-4784-994e-22a80db56c03 req-729ee11b-4314-43ac-8344-a243591814fb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041928 Aug 24 07:43:31.228318 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 228/445] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:43:31.280790 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-22dbec76-795b-4711-b257-930bf7a8312f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:31.281854 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-22dbec76-795b-4711-b257-930bf7a8312f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: 851572e6-8dda-401b-aab8-58fbe54a2b31] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:31.301828 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-22dbec76-795b-4711-b257-930bf7a8312f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:31.303615 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-22dbec76-795b-4711-b257-930bf7a8312f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:31.304180 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-22dbec76-795b-4711-b257-930bf7a8312f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:31.304995 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-22dbec76-795b-4711-b257-930bf7a8312f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:31.310449 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-22dbec76-795b-4711-b257-930bf7a8312f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:31.311058 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-22dbec76-795b-4711-b257-930bf7a8312f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:31.341382 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-bd477127-9dc2-4c0b-aa27-890802e91828 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:31.373779 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-bd477127-9dc2-4c0b-aa27-890802e91828 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 200 len: 1676 microversion: 2.1 time: 0.277901 Aug 24 07:43:31.374361 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 218/446] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:31 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 1676 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:31.534448 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-22dbec76-795b-4711-b257-930bf7a8312f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:31.557870 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-deb8d85e-a537-4879-b941-d7668f376667 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:31.558546 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-deb8d85e-a537-4879-b941-d7668f376667 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] [instance: b03f29f3-9610-46c2-908b-80a6029e29e7] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:31.559820 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-22dbec76-795b-4711-b257-930bf7a8312f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31" status: 200 len: 1366 microversion: 2.1 time: 0.289202 Aug 24 07:43:31.571146 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 229/447] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:31 2022] GET /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31 => generated 1366 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:31.576084 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-deb8d85e-a537-4879-b941-d7668f376667 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:31.576569 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-deb8d85e-a537-4879-b941-d7668f376667 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:31.577037 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-deb8d85e-a537-4879-b941-d7668f376667 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:31.577905 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-deb8d85e-a537-4879-b941-d7668f376667 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:31.578560 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-deb8d85e-a537-4879-b941-d7668f376667 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:31.579359 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-deb8d85e-a537-4879-b941-d7668f376667 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:31.622135 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-deb8d85e-a537-4879-b941-d7668f376667 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:31.622747 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-deb8d85e-a537-4879-b941-d7668f376667 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:31.623205 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-deb8d85e-a537-4879-b941-d7668f376667 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:31.624469 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.objects.instance [None req-deb8d85e-a537-4879-b941-d7668f376667 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lazy-loading 'fault' on Instance uuid b03f29f3-9610-46c2-908b-80a6029e29e7 {{(pid=127113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:43:31.629499 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:31.679875 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-deb8d85e-a537-4879-b941-d7668f376667 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7963a259502456da3f2113e08557a0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea75360af6084fa0a228bb86e711482a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:31.688521 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-deb8d85e-a537-4879-b941-d7668f376667 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] 10.222.0.42 "GET /compute/v2.1/servers/b03f29f3-9610-46c2-908b-80a6029e29e7" status: 200 len: 1304 microversion: 2.1 time: 0.139708 Aug 24 07:43:31.690147 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 219/448] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:31 2022] GET /compute/v2.1/servers/b03f29f3-9610-46c2-908b-80a6029e29e7 => generated 1304 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:43:31.733399 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-6c06d75c-2807-4393-8899-0680f0b2e391 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:31.733948 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-6c06d75c-2807-4393-8899-0680f0b2e391 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 6f20697e-980b-4345-addc-d4907757ff37] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:31.740457 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6c06d75c-2807-4393-8899-0680f0b2e391 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:31.740933 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6c06d75c-2807-4393-8899-0680f0b2e391 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:31.741368 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6c06d75c-2807-4393-8899-0680f0b2e391 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:31.742052 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6c06d75c-2807-4393-8899-0680f0b2e391 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:31.742505 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6c06d75c-2807-4393-8899-0680f0b2e391 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:31.742980 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6c06d75c-2807-4393-8899-0680f0b2e391 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:31.761034 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:31.876455 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-6c06d75c-2807-4393-8899-0680f0b2e391 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:31.884758 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-6c06d75c-2807-4393-8899-0680f0b2e391 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37" status: 200 len: 1266 microversion: 2.1 time: 0.155383 Aug 24 07:43:31.885318 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 230/449] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:31 2022] GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:32.204587 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-ec2b8813-518c-44a6-bf05-ed3fc3d1a4fd tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:32.205220 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-ec2b8813-518c-44a6-bf05-ed3fc3d1a4fd tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] [instance: 6821366f-ec0b-431d-86ef-393f5b0f728f] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:32.212106 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ec2b8813-518c-44a6-bf05-ed3fc3d1a4fd tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:32.212584 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ec2b8813-518c-44a6-bf05-ed3fc3d1a4fd tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:32.213010 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ec2b8813-518c-44a6-bf05-ed3fc3d1a4fd tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:32.213691 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ec2b8813-518c-44a6-bf05-ed3fc3d1a4fd tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:32.214131 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ec2b8813-518c-44a6-bf05-ed3fc3d1a4fd tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:32.214543 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ec2b8813-518c-44a6-bf05-ed3fc3d1a4fd tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:32.405034 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-06be4dce-056c-4172-b936-d83ea2c78a6e tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:32.405648 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-06be4dce-056c-4172-b936-d83ea2c78a6e tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:32.413059 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-06be4dce-056c-4172-b936-d83ea2c78a6e tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:32.413543 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-06be4dce-056c-4172-b936-d83ea2c78a6e tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:32.413975 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-06be4dce-056c-4172-b936-d83ea2c78a6e tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:32.414673 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-06be4dce-056c-4172-b936-d83ea2c78a6e tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:32.415166 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-06be4dce-056c-4172-b936-d83ea2c78a6e tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:32.415583 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-06be4dce-056c-4172-b936-d83ea2c78a6e tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:32.535332 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-ec2b8813-518c-44a6-bf05-ed3fc3d1a4fd tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74594b3982264446b73d14bad3f46045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf922510f54d4d40ac00486394d67a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:32.546092 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-ec2b8813-518c-44a6-bf05-ed3fc3d1a4fd tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] 10.222.0.42 "GET /compute/v2.1/servers/6821366f-ec0b-431d-86ef-393f5b0f728f" status: 200 len: 1276 microversion: 2.1 time: 0.345241 Aug 24 07:43:32.547879 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 220/450] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:32 2022] GET /compute/v2.1/servers/6821366f-ec0b-431d-86ef-393f5b0f728f => generated 1276 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:32.549138 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-06be4dce-056c-4172-b936-d83ea2c78a6e tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:32.559522 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-06be4dce-056c-4172-b936-d83ea2c78a6e tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 200 len: 1676 microversion: 2.1 time: 0.158404 Aug 24 07:43:32.560288 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 231/451] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:32 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:43:32.589837 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-10e0e80a-2c17-4c69-bc11-72740e7e272e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:32.590631 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-10e0e80a-2c17-4c69-bc11-72740e7e272e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: 851572e6-8dda-401b-aab8-58fbe54a2b31] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:32.598417 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-10e0e80a-2c17-4c69-bc11-72740e7e272e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:32.599080 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-10e0e80a-2c17-4c69-bc11-72740e7e272e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:32.599960 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-10e0e80a-2c17-4c69-bc11-72740e7e272e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:32.600824 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-10e0e80a-2c17-4c69-bc11-72740e7e272e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:32.601388 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-10e0e80a-2c17-4c69-bc11-72740e7e272e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:32.601856 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-10e0e80a-2c17-4c69-bc11-72740e7e272e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:32.710313 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-c4652db4-522b-49cf-82e8-5ebf05959ce7 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:32.711214 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-c4652db4-522b-49cf-82e8-5ebf05959ce7 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] [instance: b03f29f3-9610-46c2-908b-80a6029e29e7] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:32.717968 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c4652db4-522b-49cf-82e8-5ebf05959ce7 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:32.718809 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c4652db4-522b-49cf-82e8-5ebf05959ce7 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:32.719477 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c4652db4-522b-49cf-82e8-5ebf05959ce7 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:32.720268 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c4652db4-522b-49cf-82e8-5ebf05959ce7 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:32.721479 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c4652db4-522b-49cf-82e8-5ebf05959ce7 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:32.722093 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c4652db4-522b-49cf-82e8-5ebf05959ce7 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:32.737749 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.wsgi [None req-c4652db4-522b-49cf-82e8-5ebf05959ce7 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] HTTP exception thrown: Instance b03f29f3-9610-46c2-908b-80a6029e29e7 could not be found. Aug 24 07:43:32.739682 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-c4652db4-522b-49cf-82e8-5ebf05959ce7 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Request method failure captured: Aug 24 07:43:32.739682 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: request: GET /compute/v2.1/servers/b03f29f3-9610-46c2-908b-80a6029e29e7 HTTP/1.1 Aug 24 07:43:32.739682 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept: application/json Aug 24 07:43:32.739682 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept-Encoding: identity Aug 24 07:43:32.739682 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Connection: close Aug 24 07:43:32.739682 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Length: 0 Aug 24 07:43:32.739682 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Type: application/json Aug 24 07:43:32.739682 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Host: 10.222.0.42 Aug 24 07:43:32.739682 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Openstack-System-Scope: None Aug 24 07:43:32.739682 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: User-Agent: python-urllib3/1.26.11 Aug 24 07:43:32.739682 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Auth-Token: gAAAAABjBdaDdV7ceW5vLB965gtjDefqyx3EfL19k9-HdNkK66_x6P-r2GYXMLCePXQc-CaJwqYG2MYSyHZTtQZGklSrPFM7lZsdlV4mmB2_XkSgQd9ZUqXNyRN0UOFaHpfTAIVhpi9HwhQAzyTjyT8BRQn1BmZmcpkeRJjxz8Z3tkKZ5wNhUJc Aug 24 07:43:32.739682 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Id: None Aug 24 07:43:32.739682 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Name: None Aug 24 07:43:32.739682 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Identity-Status: Confirmed Aug 24 07:43:32.739682 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Is-Admin-Project: True Aug 24 07:43:32.739682 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Id: default Aug 24 07:43:32.739682 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Name: Default Aug 24 07:43:32.739682 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Id: ea75360af6084fa0a228bb86e711482a Aug 24 07:43:32.739682 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Name: tempest-VolumesNegativeTest-518047604 Aug 24 07:43:32.739682 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Role: reader,member Aug 24 07:43:32.739682 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Roles: reader,member Aug 24 07:43:32.740983 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ea75360af6084fa0a228bb86e711482a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ea75360af6084fa0a228bb86e711482a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ea75360af6084fa0a228bb86e711482a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ea75360af6084fa0a228bb86e711482a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:43:32.740983 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant: tempest-VolumesNegativeTest-518047604 Aug 24 07:43:32.740983 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Id: ea75360af6084fa0a228bb86e711482a Aug 24 07:43:32.740983 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Name: tempest-VolumesNegativeTest-518047604 Aug 24 07:43:32.740983 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User: tempest-VolumesNegativeTest-518047604-project Aug 24 07:43:32.740983 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Id: default Aug 24 07:43:32.740983 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Name: Default Aug 24 07:43:32.740983 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Id: e7963a259502456da3f2113e08557a0f Aug 24 07:43:32.740983 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Name: tempest-VolumesNegativeTest-518047604-project Aug 24 07:43:32.740983 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: method: > Aug 24 07:43:32.740983 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: exception: Instance b03f29f3-9610-46c2-908b-80a6029e29e7 could not be found. Aug 24 07:43:32.740983 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: action_args: {'id': 'b03f29f3-9610-46c2-908b-80a6029e29e7'} Aug 24 07:43:32.741707 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:43:32.741707 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:43:32.741707 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:43:32.741707 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:43:32.741707 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:43:32.741707 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:43:32.741707 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:43:32.741707 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:43:32.741707 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:43:32.741707 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:43:32.741707 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b03f29f3-9610-46c2-908b-80a6029e29e7 could not be found. Aug 24 07:43:32.741707 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:43:32.741707 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:43:32.741707 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:43:32.741707 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:43:32.741707 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:43:32.741707 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:43:32.741707 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:43:32.741707 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:43:32.741707 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:43:32.742921 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:43:32.742921 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 07:43:32.742921 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 07:43:32.742921 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:43:32.742921 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:43:32.742921 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:43:32.742921 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:43:32.742921 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b03f29f3-9610-46c2-908b-80a6029e29e7 could not be found. Aug 24 07:43:32.742921 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:43:32.742921 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:43:32.742921 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:43:32.742921 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:43:32.742921 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:43:32.742921 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:43:32.742921 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:43:32.742921 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:43:32.742921 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b03f29f3-9610-46c2-908b-80a6029e29e7 could not be found. Aug 24 07:43:32.742921 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:43:32.745538 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-c4652db4-522b-49cf-82e8-5ebf05959ce7 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] Returning 404 to user: Instance b03f29f3-9610-46c2-908b-80a6029e29e7 could not be found. {{(pid=127114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:43:32.747020 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-c4652db4-522b-49cf-82e8-5ebf05959ce7 tempest-VolumesNegativeTest-518047604 tempest-VolumesNegativeTest-518047604-project] 10.222.0.42 "GET /compute/v2.1/servers/b03f29f3-9610-46c2-908b-80a6029e29e7" status: 404 len: 111 microversion: 2.1 time: 0.040465 Aug 24 07:43:32.747774 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 232/452] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:32 2022] GET /compute/v2.1/servers/b03f29f3-9610-46c2-908b-80a6029e29e7 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 07:43:32.752567 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [req-f6d933f6-6137-429c-b07b-a50622c7ee73 req-407a20b9-963b-4817-b6aa-c455d234b76b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "851572e6-8dda-401b-aab8-58fbe54a2b31", "name": "network-vif-plugged", "status": "completed", "tag": "7aba0a71-3684-421c-8bb6-d7a57f843f6f"}]} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:43:32.763897 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-f6d933f6-6137-429c-b07b-a50622c7ee73 req-407a20b9-963b-4817-b6aa-c455d234b76b service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:32.764667 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-f6d933f6-6137-429c-b07b-a50622c7ee73 req-407a20b9-963b-4817-b6aa-c455d234b76b service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:32.765310 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-f6d933f6-6137-429c-b07b-a50622c7ee73 req-407a20b9-963b-4817-b6aa-c455d234b76b service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:32.778237 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.compute.server_external_events [req-f6d933f6-6137-429c-b07b-a50622c7ee73 req-407a20b9-963b-4817-b6aa-c455d234b76b service nova] Creating event network-vif-plugged:7aba0a71-3684-421c-8bb6-d7a57f843f6f for instance 851572e6-8dda-401b-aab8-58fbe54a2b31 on hv-cinder-85427 Aug 24 07:43:32.784035 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [req-f6d933f6-6137-429c-b07b-a50622c7ee73 req-407a20b9-963b-4817-b6aa-c455d234b76b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034396 Aug 24 07:43:32.785186 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 233/453] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:43:32.832499 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-10e0e80a-2c17-4c69-bc11-72740e7e272e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:32.841674 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-10e0e80a-2c17-4c69-bc11-72740e7e272e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31" status: 200 len: 1366 microversion: 2.1 time: 0.255599 Aug 24 07:43:32.843027 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 221/454] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:32 2022] GET /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31 => generated 1366 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:32.910505 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-f4a93bbf-75d9-43e6-a71b-288735d1d4e3 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:32.911469 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-f4a93bbf-75d9-43e6-a71b-288735d1d4e3 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 6f20697e-980b-4345-addc-d4907757ff37] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:32.919503 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f4a93bbf-75d9-43e6-a71b-288735d1d4e3 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:32.920157 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f4a93bbf-75d9-43e6-a71b-288735d1d4e3 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:32.920666 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f4a93bbf-75d9-43e6-a71b-288735d1d4e3 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:32.921934 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f4a93bbf-75d9-43e6-a71b-288735d1d4e3 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:32.922647 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f4a93bbf-75d9-43e6-a71b-288735d1d4e3 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:32.923266 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f4a93bbf-75d9-43e6-a71b-288735d1d4e3 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:33.134219 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-f4a93bbf-75d9-43e6-a71b-288735d1d4e3 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:33.143524 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-f4a93bbf-75d9-43e6-a71b-288735d1d4e3 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37" status: 200 len: 1266 microversion: 2.1 time: 0.237856 Aug 24 07:43:33.144104 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 234/455] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:32 2022] GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37 => generated 1266 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:33.436439 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [req-e88936c6-6f9b-4474-8d38-82a8e2333e1a req-ca1a4a4a-1696-4ea4-ac05-af9d138b6d3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6821366f-ec0b-431d-86ef-393f5b0f728f", "tag": "2c221772-7ae4-4b1a-9144-6e18a1629c15"}]} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:43:33.450729 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-e88936c6-6f9b-4474-8d38-82a8e2333e1a req-ca1a4a4a-1696-4ea4-ac05-af9d138b6d3e service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:33.451408 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-e88936c6-6f9b-4474-8d38-82a8e2333e1a req-ca1a4a4a-1696-4ea4-ac05-af9d138b6d3e service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:33.451833 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-e88936c6-6f9b-4474-8d38-82a8e2333e1a req-ca1a4a4a-1696-4ea4-ac05-af9d138b6d3e service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:33.464795 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.compute.server_external_events [req-e88936c6-6f9b-4474-8d38-82a8e2333e1a req-ca1a4a4a-1696-4ea4-ac05-af9d138b6d3e service nova] Creating event network-changed:2c221772-7ae4-4b1a-9144-6e18a1629c15 for instance 6821366f-ec0b-431d-86ef-393f5b0f728f on hv-cinder-85427 Aug 24 07:43:33.470555 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [req-e88936c6-6f9b-4474-8d38-82a8e2333e1a req-ca1a4a4a-1696-4ea4-ac05-af9d138b6d3e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038084 Aug 24 07:43:33.471780 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 222/456] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:43:33.572472 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-542c86cc-04f4-422d-9fd5-8bc74cba10fb tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:33.573073 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-542c86cc-04f4-422d-9fd5-8bc74cba10fb tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] [instance: 6821366f-ec0b-431d-86ef-393f5b0f728f] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:33.583350 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-542c86cc-04f4-422d-9fd5-8bc74cba10fb tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:33.583842 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-542c86cc-04f4-422d-9fd5-8bc74cba10fb tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:33.584265 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-542c86cc-04f4-422d-9fd5-8bc74cba10fb tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:33.584452 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-e02e1bef-ee8f-40d2-91d1-127ca8119f95 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:33.585139 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-e02e1bef-ee8f-40d2-91d1-127ca8119f95 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:33.585642 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-542c86cc-04f4-422d-9fd5-8bc74cba10fb tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:33.586263 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-542c86cc-04f4-422d-9fd5-8bc74cba10fb tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:33.587384 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-542c86cc-04f4-422d-9fd5-8bc74cba10fb tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:33.593769 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e02e1bef-ee8f-40d2-91d1-127ca8119f95 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:33.594244 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e02e1bef-ee8f-40d2-91d1-127ca8119f95 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:33.595511 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e02e1bef-ee8f-40d2-91d1-127ca8119f95 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:33.596237 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e02e1bef-ee8f-40d2-91d1-127ca8119f95 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:33.597263 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e02e1bef-ee8f-40d2-91d1-127ca8119f95 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:33.597680 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e02e1bef-ee8f-40d2-91d1-127ca8119f95 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:33.731972 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-542c86cc-04f4-422d-9fd5-8bc74cba10fb tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74594b3982264446b73d14bad3f46045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf922510f54d4d40ac00486394d67a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:33.741053 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-542c86cc-04f4-422d-9fd5-8bc74cba10fb tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] 10.222.0.42 "GET /compute/v2.1/servers/6821366f-ec0b-431d-86ef-393f5b0f728f" status: 200 len: 1318 microversion: 2.1 time: 0.172275 Aug 24 07:43:33.745125 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-e02e1bef-ee8f-40d2-91d1-127ca8119f95 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:33.753395 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-e02e1bef-ee8f-40d2-91d1-127ca8119f95 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 200 len: 1676 microversion: 2.1 time: 0.176394 Aug 24 07:43:33.753953 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 223/457] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:33 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 1676 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:43:33.754856 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 235/458] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:33 2022] GET /compute/v2.1/servers/6821366f-ec0b-431d-86ef-393f5b0f728f => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:33.868901 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-c70d9fd7-b53a-4c7c-9c07-05c7dbd92619 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:33.869502 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-c70d9fd7-b53a-4c7c-9c07-05c7dbd92619 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: 851572e6-8dda-401b-aab8-58fbe54a2b31] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:33.875545 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c70d9fd7-b53a-4c7c-9c07-05c7dbd92619 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:33.876022 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c70d9fd7-b53a-4c7c-9c07-05c7dbd92619 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:33.876455 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c70d9fd7-b53a-4c7c-9c07-05c7dbd92619 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:33.877169 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c70d9fd7-b53a-4c7c-9c07-05c7dbd92619 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:33.877642 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c70d9fd7-b53a-4c7c-9c07-05c7dbd92619 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:33.878124 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c70d9fd7-b53a-4c7c-9c07-05c7dbd92619 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:34.067812 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-c70d9fd7-b53a-4c7c-9c07-05c7dbd92619 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:34.077006 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-c70d9fd7-b53a-4c7c-9c07-05c7dbd92619 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31" status: 200 len: 1366 microversion: 2.1 time: 0.211942 Aug 24 07:43:34.077811 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 224/459] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:33 2022] GET /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31 => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:34.164847 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-744504c0-24e3-4066-a696-a229403bdd9c tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:34.165456 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-744504c0-24e3-4066-a696-a229403bdd9c tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 6f20697e-980b-4345-addc-d4907757ff37] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:34.171414 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-744504c0-24e3-4066-a696-a229403bdd9c tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:34.171888 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-744504c0-24e3-4066-a696-a229403bdd9c tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:34.178280 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-744504c0-24e3-4066-a696-a229403bdd9c tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:34.179097 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-744504c0-24e3-4066-a696-a229403bdd9c tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:34.179565 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-744504c0-24e3-4066-a696-a229403bdd9c tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:34.180002 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-744504c0-24e3-4066-a696-a229403bdd9c tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:34.332224 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-744504c0-24e3-4066-a696-a229403bdd9c tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:34.339897 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-744504c0-24e3-4066-a696-a229403bdd9c tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37" status: 200 len: 1266 microversion: 2.1 time: 0.178786 Aug 24 07:43:34.340465 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 236/460] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:34 2022] GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:34.761186 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-a2f58f31-6f51-4573-b3b6-235fd93a3172 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:34.761795 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-a2f58f31-6f51-4573-b3b6-235fd93a3172 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] [instance: 6821366f-ec0b-431d-86ef-393f5b0f728f] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:34.769367 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a2f58f31-6f51-4573-b3b6-235fd93a3172 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:34.769855 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a2f58f31-6f51-4573-b3b6-235fd93a3172 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:34.770291 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a2f58f31-6f51-4573-b3b6-235fd93a3172 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:34.771021 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a2f58f31-6f51-4573-b3b6-235fd93a3172 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:34.771472 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a2f58f31-6f51-4573-b3b6-235fd93a3172 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:34.771891 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a2f58f31-6f51-4573-b3b6-235fd93a3172 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:34.773767 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-9ee38fcc-97e2-42a2-9dbe-6dc622be4f2d tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:34.774772 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-9ee38fcc-97e2-42a2-9dbe-6dc622be4f2d tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:34.782114 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9ee38fcc-97e2-42a2-9dbe-6dc622be4f2d tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:34.782746 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9ee38fcc-97e2-42a2-9dbe-6dc622be4f2d tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:34.783871 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9ee38fcc-97e2-42a2-9dbe-6dc622be4f2d tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:34.784556 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9ee38fcc-97e2-42a2-9dbe-6dc622be4f2d tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:34.785079 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9ee38fcc-97e2-42a2-9dbe-6dc622be4f2d tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:34.785562 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9ee38fcc-97e2-42a2-9dbe-6dc622be4f2d tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:34.956124 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-9ee38fcc-97e2-42a2-9dbe-6dc622be4f2d tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:34.964691 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-9ee38fcc-97e2-42a2-9dbe-6dc622be4f2d tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 200 len: 1676 microversion: 2.1 time: 0.194793 Aug 24 07:43:34.965311 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-a2f58f31-6f51-4573-b3b6-235fd93a3172 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74594b3982264446b73d14bad3f46045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf922510f54d4d40ac00486394d67a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:34.965462 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 237/461] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:34 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 1676 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:43:34.977014 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-a2f58f31-6f51-4573-b3b6-235fd93a3172 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] 10.222.0.42 "GET /compute/v2.1/servers/6821366f-ec0b-431d-86ef-393f5b0f728f" status: 200 len: 1318 microversion: 2.1 time: 0.219594 Aug 24 07:43:34.977703 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 225/462] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:34 2022] GET /compute/v2.1/servers/6821366f-ec0b-431d-86ef-393f5b0f728f => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:35.099634 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-a9ecc458-fccf-4b86-9a4c-c04a28912236 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:35.100425 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-a9ecc458-fccf-4b86-9a4c-c04a28912236 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: 851572e6-8dda-401b-aab8-58fbe54a2b31] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:35.106646 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a9ecc458-fccf-4b86-9a4c-c04a28912236 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:35.107156 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a9ecc458-fccf-4b86-9a4c-c04a28912236 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:35.107610 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a9ecc458-fccf-4b86-9a4c-c04a28912236 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:35.108299 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a9ecc458-fccf-4b86-9a4c-c04a28912236 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:35.108751 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a9ecc458-fccf-4b86-9a4c-c04a28912236 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:35.109170 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a9ecc458-fccf-4b86-9a4c-c04a28912236 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:35.240631 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-a9ecc458-fccf-4b86-9a4c-c04a28912236 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:35.248260 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-a9ecc458-fccf-4b86-9a4c-c04a28912236 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31" status: 200 len: 1556 microversion: 2.1 time: 0.153343 Aug 24 07:43:35.249316 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 238/463] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:35 2022] GET /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31 => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:35.269656 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-abfe9108-898e-4d0f-81c8-1851c8df0746 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:35.270128 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-abfe9108-898e-4d0f-81c8-1851c8df0746 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: 851572e6-8dda-401b-aab8-58fbe54a2b31] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:35.276676 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-abfe9108-898e-4d0f-81c8-1851c8df0746 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:35.277159 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-abfe9108-898e-4d0f-81c8-1851c8df0746 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:35.277583 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-abfe9108-898e-4d0f-81c8-1851c8df0746 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:35.278446 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-abfe9108-898e-4d0f-81c8-1851c8df0746 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:35.278911 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-abfe9108-898e-4d0f-81c8-1851c8df0746 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:35.279330 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-abfe9108-898e-4d0f-81c8-1851c8df0746 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:35.359533 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-abfe9108-898e-4d0f-81c8-1851c8df0746 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094508 Aug 24 07:43:35.360114 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 226/464] 10.222.0.42 () {58 vars in 1275 bytes} [Wed Aug 24 07:43:35 2022] GET /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:43:35.360696 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-db7161b2-af46-4202-99a9-a32a5eeb4d9c tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:35.361295 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-db7161b2-af46-4202-99a9-a32a5eeb4d9c tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 6f20697e-980b-4345-addc-d4907757ff37] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:35.367579 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-db7161b2-af46-4202-99a9-a32a5eeb4d9c tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:35.368066 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-db7161b2-af46-4202-99a9-a32a5eeb4d9c tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:35.368501 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-db7161b2-af46-4202-99a9-a32a5eeb4d9c tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:35.369322 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-db7161b2-af46-4202-99a9-a32a5eeb4d9c tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:35.370083 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-db7161b2-af46-4202-99a9-a32a5eeb4d9c tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:35.370547 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-db7161b2-af46-4202-99a9-a32a5eeb4d9c tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:35.521622 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-db7161b2-af46-4202-99a9-a32a5eeb4d9c tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:35.533966 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-db7161b2-af46-4202-99a9-a32a5eeb4d9c tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37" status: 200 len: 1266 microversion: 2.1 time: 0.176972 Aug 24 07:43:35.534629 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 239/465] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:35 2022] GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:35.988102 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-0ad3828e-bc47-4d97-b6cd-614b6090d6be tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:35.988764 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-0ad3828e-bc47-4d97-b6cd-614b6090d6be tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:35.995115 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0ad3828e-bc47-4d97-b6cd-614b6090d6be tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:35.995596 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0ad3828e-bc47-4d97-b6cd-614b6090d6be tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:35.996026 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0ad3828e-bc47-4d97-b6cd-614b6090d6be tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:35.996714 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0ad3828e-bc47-4d97-b6cd-614b6090d6be tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:35.997157 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0ad3828e-bc47-4d97-b6cd-614b6090d6be tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:35.997566 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0ad3828e-bc47-4d97-b6cd-614b6090d6be tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:35.998953 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-9c5ee585-ad5f-478e-a3b4-eff4d96a2862 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:35.999658 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-9c5ee585-ad5f-478e-a3b4-eff4d96a2862 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] [instance: 6821366f-ec0b-431d-86ef-393f5b0f728f] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:36.008408 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9c5ee585-ad5f-478e-a3b4-eff4d96a2862 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:36.009014 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9c5ee585-ad5f-478e-a3b4-eff4d96a2862 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:36.009548 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9c5ee585-ad5f-478e-a3b4-eff4d96a2862 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:36.010499 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9c5ee585-ad5f-478e-a3b4-eff4d96a2862 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:36.011085 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9c5ee585-ad5f-478e-a3b4-eff4d96a2862 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:36.011606 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9c5ee585-ad5f-478e-a3b4-eff4d96a2862 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:36.151587 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-9c5ee585-ad5f-478e-a3b4-eff4d96a2862 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74594b3982264446b73d14bad3f46045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf922510f54d4d40ac00486394d67a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:36.160016 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-9c5ee585-ad5f-478e-a3b4-eff4d96a2862 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] 10.222.0.42 "GET /compute/v2.1/servers/6821366f-ec0b-431d-86ef-393f5b0f728f" status: 200 len: 1318 microversion: 2.1 time: 0.166174 Aug 24 07:43:36.160781 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 240/466] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:35 2022] GET /compute/v2.1/servers/6821366f-ec0b-431d-86ef-393f5b0f728f => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:36.251225 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-0ad3828e-bc47-4d97-b6cd-614b6090d6be tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:36.258727 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-0ad3828e-bc47-4d97-b6cd-614b6090d6be tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 200 len: 1676 microversion: 2.1 time: 0.275610 Aug 24 07:43:36.259293 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 227/467] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:35 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 1676 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:36.428429 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [req-89f9c905-9acf-48eb-9000-28e7082aaf8f req-c8f5ad3a-cc3f-47d1-a11e-e42eecb559f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "851572e6-8dda-401b-aab8-58fbe54a2b31", "tag": "7aba0a71-3684-421c-8bb6-d7a57f843f6f"}]} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:43:36.438387 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-89f9c905-9acf-48eb-9000-28e7082aaf8f req-c8f5ad3a-cc3f-47d1-a11e-e42eecb559f1 service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:36.438974 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-89f9c905-9acf-48eb-9000-28e7082aaf8f req-c8f5ad3a-cc3f-47d1-a11e-e42eecb559f1 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:36.439508 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-89f9c905-9acf-48eb-9000-28e7082aaf8f req-c8f5ad3a-cc3f-47d1-a11e-e42eecb559f1 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:36.450333 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.compute.server_external_events [req-89f9c905-9acf-48eb-9000-28e7082aaf8f req-c8f5ad3a-cc3f-47d1-a11e-e42eecb559f1 service nova] Creating event network-changed:7aba0a71-3684-421c-8bb6-d7a57f843f6f for instance 851572e6-8dda-401b-aab8-58fbe54a2b31 on hv-cinder-85427 Aug 24 07:43:36.455795 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [req-89f9c905-9acf-48eb-9000-28e7082aaf8f req-c8f5ad3a-cc3f-47d1-a11e-e42eecb559f1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031026 Aug 24 07:43:36.456370 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 241/468] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:43:36.554094 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-af57326d-ef96-420a-8282-2ec879518557 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:36.554856 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-af57326d-ef96-420a-8282-2ec879518557 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 6f20697e-980b-4345-addc-d4907757ff37] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:36.560974 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-af57326d-ef96-420a-8282-2ec879518557 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:36.561454 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-af57326d-ef96-420a-8282-2ec879518557 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:36.561891 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-af57326d-ef96-420a-8282-2ec879518557 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:36.562578 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-af57326d-ef96-420a-8282-2ec879518557 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:36.563088 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-af57326d-ef96-420a-8282-2ec879518557 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:36.563512 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-af57326d-ef96-420a-8282-2ec879518557 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:36.700113 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-af57326d-ef96-420a-8282-2ec879518557 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:36.708528 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-af57326d-ef96-420a-8282-2ec879518557 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37" status: 200 len: 1266 microversion: 2.1 time: 0.158198 Aug 24 07:43:36.709096 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 228/469] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:36 2022] GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:37.183090 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-e19d3319-77ad-4847-9d8f-376647c000c2 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:37.184332 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-e19d3319-77ad-4847-9d8f-376647c000c2 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] [instance: 6821366f-ec0b-431d-86ef-393f5b0f728f] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:37.192039 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e19d3319-77ad-4847-9d8f-376647c000c2 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:37.192743 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e19d3319-77ad-4847-9d8f-376647c000c2 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:37.193326 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e19d3319-77ad-4847-9d8f-376647c000c2 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:37.194285 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e19d3319-77ad-4847-9d8f-376647c000c2 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:37.194919 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e19d3319-77ad-4847-9d8f-376647c000c2 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:37.195494 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e19d3319-77ad-4847-9d8f-376647c000c2 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:37.284819 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-7451b91a-c6cd-42b0-8571-f6e3da10d330 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:37.286880 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-7451b91a-c6cd-42b0-8571-f6e3da10d330 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:37.294061 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7451b91a-c6cd-42b0-8571-f6e3da10d330 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:37.294986 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7451b91a-c6cd-42b0-8571-f6e3da10d330 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:37.295666 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7451b91a-c6cd-42b0-8571-f6e3da10d330 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:37.296925 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7451b91a-c6cd-42b0-8571-f6e3da10d330 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:37.298259 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7451b91a-c6cd-42b0-8571-f6e3da10d330 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:37.298947 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7451b91a-c6cd-42b0-8571-f6e3da10d330 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:37.454299 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-e19d3319-77ad-4847-9d8f-376647c000c2 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74594b3982264446b73d14bad3f46045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf922510f54d4d40ac00486394d67a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:37.471461 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-e19d3319-77ad-4847-9d8f-376647c000c2 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] 10.222.0.42 "GET /compute/v2.1/servers/6821366f-ec0b-431d-86ef-393f5b0f728f" status: 200 len: 1318 microversion: 2.1 time: 0.294264 Aug 24 07:43:37.472051 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 242/470] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:37 2022] GET /compute/v2.1/servers/6821366f-ec0b-431d-86ef-393f5b0f728f => generated 1318 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:37.497777 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-7451b91a-c6cd-42b0-8571-f6e3da10d330 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:37.507293 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-7451b91a-c6cd-42b0-8571-f6e3da10d330 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 200 len: 1676 microversion: 2.1 time: 0.230817 Aug 24 07:43:37.507864 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 229/471] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:37 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 1676 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:43:37.728655 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-bce81f02-bee7-4647-be53-8a6387207451 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:37.729272 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-bce81f02-bee7-4647-be53-8a6387207451 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 6f20697e-980b-4345-addc-d4907757ff37] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:37.737930 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-bce81f02-bee7-4647-be53-8a6387207451 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:37.738439 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-bce81f02-bee7-4647-be53-8a6387207451 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:37.738978 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-bce81f02-bee7-4647-be53-8a6387207451 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:37.739823 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-bce81f02-bee7-4647-be53-8a6387207451 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:37.740277 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-bce81f02-bee7-4647-be53-8a6387207451 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:37.740935 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-bce81f02-bee7-4647-be53-8a6387207451 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:37.884211 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-bce81f02-bee7-4647-be53-8a6387207451 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:37.892342 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-bce81f02-bee7-4647-be53-8a6387207451 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37" status: 200 len: 1266 microversion: 2.1 time: 0.167553 Aug 24 07:43:37.892934 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 243/472] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:37 2022] GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:38.492809 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-050ca0c1-f61c-47a2-865d-010b2bd7b185 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:38.493399 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-050ca0c1-f61c-47a2-865d-010b2bd7b185 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] [instance: 6821366f-ec0b-431d-86ef-393f5b0f728f] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:38.499827 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-050ca0c1-f61c-47a2-865d-010b2bd7b185 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:38.500303 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-050ca0c1-f61c-47a2-865d-010b2bd7b185 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:38.500731 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-050ca0c1-f61c-47a2-865d-010b2bd7b185 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:38.501648 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-050ca0c1-f61c-47a2-865d-010b2bd7b185 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:38.502207 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-050ca0c1-f61c-47a2-865d-010b2bd7b185 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:38.502649 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-050ca0c1-f61c-47a2-865d-010b2bd7b185 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:38.528835 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-de30767b-bca3-4b93-b9bb-9f0636404ed3 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:38.529438 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-de30767b-bca3-4b93-b9bb-9f0636404ed3 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:38.536462 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-de30767b-bca3-4b93-b9bb-9f0636404ed3 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:38.536942 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-de30767b-bca3-4b93-b9bb-9f0636404ed3 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:38.537372 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-de30767b-bca3-4b93-b9bb-9f0636404ed3 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:38.538060 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-de30767b-bca3-4b93-b9bb-9f0636404ed3 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:38.538510 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-de30767b-bca3-4b93-b9bb-9f0636404ed3 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:38.538952 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-de30767b-bca3-4b93-b9bb-9f0636404ed3 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:38.636617 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-050ca0c1-f61c-47a2-865d-010b2bd7b185 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74594b3982264446b73d14bad3f46045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf922510f54d4d40ac00486394d67a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:38.644730 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-050ca0c1-f61c-47a2-865d-010b2bd7b185 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] 10.222.0.42 "GET /compute/v2.1/servers/6821366f-ec0b-431d-86ef-393f5b0f728f" status: 200 len: 1318 microversion: 2.1 time: 0.155758 Aug 24 07:43:38.653493 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 230/473] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:38 2022] GET /compute/v2.1/servers/6821366f-ec0b-431d-86ef-393f5b0f728f => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:38.689988 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-de30767b-bca3-4b93-b9bb-9f0636404ed3 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:38.697687 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-de30767b-bca3-4b93-b9bb-9f0636404ed3 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 200 len: 1676 microversion: 2.1 time: 0.172771 Aug 24 07:43:38.698350 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 244/474] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:38 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 1676 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:43:38.913809 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-ebedf707-7670-4381-8698-83b271da9667 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:38.914221 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-ebedf707-7670-4381-8698-83b271da9667 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 6f20697e-980b-4345-addc-d4907757ff37] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:38.916304 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell0:SELECT=2 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:38.921672 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ebedf707-7670-4381-8698-83b271da9667 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:38.922228 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ebedf707-7670-4381-8698-83b271da9667 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:38.922757 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ebedf707-7670-4381-8698-83b271da9667 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:38.923570 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ebedf707-7670-4381-8698-83b271da9667 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:38.924020 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ebedf707-7670-4381-8698-83b271da9667 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:38.924440 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ebedf707-7670-4381-8698-83b271da9667 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:39.063536 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-ebedf707-7670-4381-8698-83b271da9667 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:39.071739 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-ebedf707-7670-4381-8698-83b271da9667 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37" status: 200 len: 1266 microversion: 2.1 time: 0.162148 Aug 24 07:43:39.072298 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 231/475] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:38 2022] GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:39.665325 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-44d28be2-5a8c-4329-8a41-4b18a66f0d65 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:39.665930 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-44d28be2-5a8c-4329-8a41-4b18a66f0d65 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] [instance: 6821366f-ec0b-431d-86ef-393f5b0f728f] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:39.667953 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell0:SELECT=2 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:39.668745 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell0:SELECT=6 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:39.675834 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-44d28be2-5a8c-4329-8a41-4b18a66f0d65 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:39.676318 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-44d28be2-5a8c-4329-8a41-4b18a66f0d65 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:39.676753 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-44d28be2-5a8c-4329-8a41-4b18a66f0d65 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:39.677445 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-44d28be2-5a8c-4329-8a41-4b18a66f0d65 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:39.677896 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-44d28be2-5a8c-4329-8a41-4b18a66f0d65 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:39.678353 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-44d28be2-5a8c-4329-8a41-4b18a66f0d65 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:39.721107 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-493a3542-a9ef-41b3-97ca-55ea76ae6f88 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:39.722376 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-493a3542-a9ef-41b3-97ca-55ea76ae6f88 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:39.729372 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-493a3542-a9ef-41b3-97ca-55ea76ae6f88 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:39.729850 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-493a3542-a9ef-41b3-97ca-55ea76ae6f88 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:39.730276 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-493a3542-a9ef-41b3-97ca-55ea76ae6f88 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:39.730993 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-493a3542-a9ef-41b3-97ca-55ea76ae6f88 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:39.731439 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-493a3542-a9ef-41b3-97ca-55ea76ae6f88 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:39.731855 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-493a3542-a9ef-41b3-97ca-55ea76ae6f88 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:39.821788 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-44d28be2-5a8c-4329-8a41-4b18a66f0d65 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74594b3982264446b73d14bad3f46045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf922510f54d4d40ac00486394d67a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:39.829878 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-44d28be2-5a8c-4329-8a41-4b18a66f0d65 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] 10.222.0.42 "GET /compute/v2.1/servers/6821366f-ec0b-431d-86ef-393f5b0f728f" status: 200 len: 1318 microversion: 2.1 time: 0.168394 Aug 24 07:43:39.830450 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 245/476] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:39 2022] GET /compute/v2.1/servers/6821366f-ec0b-431d-86ef-393f5b0f728f => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:39.866611 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-493a3542-a9ef-41b3-97ca-55ea76ae6f88 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:39.874269 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-493a3542-a9ef-41b3-97ca-55ea76ae6f88 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 200 len: 1676 microversion: 2.1 time: 0.158826 Aug 24 07:43:39.874885 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 232/477] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:39 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:43:40.093357 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-08e168a7-5920-4e60-8dbf-3cc493d4984f tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:40.093915 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-08e168a7-5920-4e60-8dbf-3cc493d4984f tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 6f20697e-980b-4345-addc-d4907757ff37] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:40.096423 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:40.101975 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-08e168a7-5920-4e60-8dbf-3cc493d4984f tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:40.102449 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-08e168a7-5920-4e60-8dbf-3cc493d4984f tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:40.102912 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-08e168a7-5920-4e60-8dbf-3cc493d4984f tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:40.103596 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-08e168a7-5920-4e60-8dbf-3cc493d4984f tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:40.104047 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-08e168a7-5920-4e60-8dbf-3cc493d4984f tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:40.104463 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-08e168a7-5920-4e60-8dbf-3cc493d4984f tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:40.242554 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-08e168a7-5920-4e60-8dbf-3cc493d4984f tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:40.250234 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-08e168a7-5920-4e60-8dbf-3cc493d4984f tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37" status: 200 len: 1266 microversion: 2.1 time: 0.160765 Aug 24 07:43:40.250815 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 246/478] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:40 2022] GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:40.849551 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-34b79c71-1cdd-4944-8fd1-9e73d65976cb tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:40.850172 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-34b79c71-1cdd-4944-8fd1-9e73d65976cb tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] [instance: 6821366f-ec0b-431d-86ef-393f5b0f728f] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:40.856552 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-34b79c71-1cdd-4944-8fd1-9e73d65976cb tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:40.857027 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-34b79c71-1cdd-4944-8fd1-9e73d65976cb tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:40.857485 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-34b79c71-1cdd-4944-8fd1-9e73d65976cb tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:40.858163 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-34b79c71-1cdd-4944-8fd1-9e73d65976cb tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:40.858611 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-34b79c71-1cdd-4944-8fd1-9e73d65976cb tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:40.859055 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-34b79c71-1cdd-4944-8fd1-9e73d65976cb tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:40.896175 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-e55cf89d-2855-4c52-ab71-cf24371ede17 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:40.896902 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-e55cf89d-2855-4c52-ab71-cf24371ede17 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:40.903313 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e55cf89d-2855-4c52-ab71-cf24371ede17 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:40.903786 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e55cf89d-2855-4c52-ab71-cf24371ede17 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:40.904210 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e55cf89d-2855-4c52-ab71-cf24371ede17 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:40.904893 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e55cf89d-2855-4c52-ab71-cf24371ede17 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:40.905337 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e55cf89d-2855-4c52-ab71-cf24371ede17 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:40.905750 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e55cf89d-2855-4c52-ab71-cf24371ede17 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:40.991639 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-34b79c71-1cdd-4944-8fd1-9e73d65976cb tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74594b3982264446b73d14bad3f46045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf922510f54d4d40ac00486394d67a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:40.999394 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-34b79c71-1cdd-4944-8fd1-9e73d65976cb tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] 10.222.0.42 "GET /compute/v2.1/servers/6821366f-ec0b-431d-86ef-393f5b0f728f" status: 200 len: 1318 microversion: 2.1 time: 0.153889 Aug 24 07:43:41.000226 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 233/479] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:40 2022] GET /compute/v2.1/servers/6821366f-ec0b-431d-86ef-393f5b0f728f => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:41.035979 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-e55cf89d-2855-4c52-ab71-cf24371ede17 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:41.044012 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-e55cf89d-2855-4c52-ab71-cf24371ede17 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 200 len: 1676 microversion: 2.1 time: 0.151628 Aug 24 07:43:41.044570 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 247/480] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:40 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:43:41.144975 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [req-5da86b46-1a9c-4367-a1dd-6b0fc032cc89 req-040c6303-659d-4343-a87f-ace3459c1650 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f20697e-980b-4345-addc-d4907757ff37", "name": "network-vif-plugged", "status": "completed", "tag": "599f3399-205e-4f58-a04f-6a46a51e0c0e"}]} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:43:41.154607 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-5da86b46-1a9c-4367-a1dd-6b0fc032cc89 req-040c6303-659d-4343-a87f-ace3459c1650 service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:41.155138 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-5da86b46-1a9c-4367-a1dd-6b0fc032cc89 req-040c6303-659d-4343-a87f-ace3459c1650 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:41.155569 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-5da86b46-1a9c-4367-a1dd-6b0fc032cc89 req-040c6303-659d-4343-a87f-ace3459c1650 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:41.166321 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.compute.server_external_events [req-5da86b46-1a9c-4367-a1dd-6b0fc032cc89 req-040c6303-659d-4343-a87f-ace3459c1650 service nova] Creating event network-vif-plugged:599f3399-205e-4f58-a04f-6a46a51e0c0e for instance 6f20697e-980b-4345-addc-d4907757ff37 on hv-cinder-85427 Aug 24 07:43:41.171144 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [req-5da86b46-1a9c-4367-a1dd-6b0fc032cc89 req-040c6303-659d-4343-a87f-ace3459c1650 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030435 Aug 24 07:43:41.171931 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 234/481] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:43:41.270357 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-dd9f8a58-be2f-4b11-a32d-a8b45c66eb12 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:41.270987 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-dd9f8a58-be2f-4b11-a32d-a8b45c66eb12 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 6f20697e-980b-4345-addc-d4907757ff37] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:41.277436 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-dd9f8a58-be2f-4b11-a32d-a8b45c66eb12 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:41.277924 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-dd9f8a58-be2f-4b11-a32d-a8b45c66eb12 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:41.278538 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-dd9f8a58-be2f-4b11-a32d-a8b45c66eb12 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:41.279276 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-dd9f8a58-be2f-4b11-a32d-a8b45c66eb12 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:41.279724 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-dd9f8a58-be2f-4b11-a32d-a8b45c66eb12 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:41.280323 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-dd9f8a58-be2f-4b11-a32d-a8b45c66eb12 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:41.456005 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-dd9f8a58-be2f-4b11-a32d-a8b45c66eb12 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:41.463701 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-dd9f8a58-be2f-4b11-a32d-a8b45c66eb12 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37" status: 200 len: 1266 microversion: 2.1 time: 0.197875 Aug 24 07:43:41.464258 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 248/482] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:41 2022] GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37 => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:42.021491 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-3e026924-30fe-4c2d-9351-50761d066988 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:42.022163 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-3e026924-30fe-4c2d-9351-50761d066988 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] [instance: 6821366f-ec0b-431d-86ef-393f5b0f728f] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:42.028290 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3e026924-30fe-4c2d-9351-50761d066988 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:42.028755 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3e026924-30fe-4c2d-9351-50761d066988 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:42.029178 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3e026924-30fe-4c2d-9351-50761d066988 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:42.029847 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3e026924-30fe-4c2d-9351-50761d066988 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:42.030290 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3e026924-30fe-4c2d-9351-50761d066988 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:42.030716 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3e026924-30fe-4c2d-9351-50761d066988 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:42.065296 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-680d276c-3d03-4583-9e81-056b80732187 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:42.065916 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-680d276c-3d03-4583-9e81-056b80732187 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:42.072344 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-680d276c-3d03-4583-9e81-056b80732187 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:42.072818 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-680d276c-3d03-4583-9e81-056b80732187 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:42.073243 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-680d276c-3d03-4583-9e81-056b80732187 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:42.073928 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-680d276c-3d03-4583-9e81-056b80732187 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:42.074520 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-680d276c-3d03-4583-9e81-056b80732187 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:42.074966 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-680d276c-3d03-4583-9e81-056b80732187 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:42.079205 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell1:SELECT=100 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:42.162598 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-3e026924-30fe-4c2d-9351-50761d066988 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74594b3982264446b73d14bad3f46045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf922510f54d4d40ac00486394d67a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:42.170619 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-3e026924-30fe-4c2d-9351-50761d066988 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] 10.222.0.42 "GET /compute/v2.1/servers/6821366f-ec0b-431d-86ef-393f5b0f728f" status: 200 len: 1318 microversion: 2.1 time: 0.153672 Aug 24 07:43:42.171214 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 235/483] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:42 2022] GET /compute/v2.1/servers/6821366f-ec0b-431d-86ef-393f5b0f728f => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:42.205557 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-680d276c-3d03-4583-9e81-056b80732187 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:42.213141 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-680d276c-3d03-4583-9e81-056b80732187 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 200 len: 1653 microversion: 2.1 time: 0.151655 Aug 24 07:43:42.213689 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 249/484] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:42 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 1653 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:43:42.233675 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-a9756637-4ff4-4637-8385-1af3568be474 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:43:42.239561 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a9756637-4ff4-4637-8385-1af3568be474 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:42.240034 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a9756637-4ff4-4637-8385-1af3568be474 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:42.240454 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a9756637-4ff4-4637-8385-1af3568be474 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:42.261254 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-a9756637-4ff4-4637-8385-1af3568be474 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Going to try to start instance {{(pid=127113) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 07:43:42.293895 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:43:42.302594 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-a9756637-4ff4-4637-8385-1af3568be474 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "POST /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c/action" status: 202 len: 0 microversion: 2.1 time: 0.072612 Aug 24 07:43:42.303230 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 236/485] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 24 07:43:42 2022] POST /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 07:43:42.311428 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-562cdc4c-91d4-462d-b482-fd26f715b2a1 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:42.312027 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-562cdc4c-91d4-462d-b482-fd26f715b2a1 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:42.317894 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-562cdc4c-91d4-462d-b482-fd26f715b2a1 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:42.318367 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-562cdc4c-91d4-462d-b482-fd26f715b2a1 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:42.318825 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-562cdc4c-91d4-462d-b482-fd26f715b2a1 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:42.319566 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-562cdc4c-91d4-462d-b482-fd26f715b2a1 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:42.320005 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-562cdc4c-91d4-462d-b482-fd26f715b2a1 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:42.320427 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-562cdc4c-91d4-462d-b482-fd26f715b2a1 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:42.450297 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-562cdc4c-91d4-462d-b482-fd26f715b2a1 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:42.458722 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-562cdc4c-91d4-462d-b482-fd26f715b2a1 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 200 len: 1662 microversion: 2.1 time: 0.150978 Aug 24 07:43:42.459226 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 250/486] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:42 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 1662 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:42.485472 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-37056443-a707-48f8-b73d-4d011c2f6262 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:42.486232 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-37056443-a707-48f8-b73d-4d011c2f6262 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 6f20697e-980b-4345-addc-d4907757ff37] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:42.492639 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-37056443-a707-48f8-b73d-4d011c2f6262 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:42.493124 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-37056443-a707-48f8-b73d-4d011c2f6262 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:42.493556 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-37056443-a707-48f8-b73d-4d011c2f6262 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:42.494246 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-37056443-a707-48f8-b73d-4d011c2f6262 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:42.494718 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-37056443-a707-48f8-b73d-4d011c2f6262 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:42.495141 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-37056443-a707-48f8-b73d-4d011c2f6262 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:42.627754 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-37056443-a707-48f8-b73d-4d011c2f6262 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:42.635869 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-37056443-a707-48f8-b73d-4d011c2f6262 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37" status: 200 len: 1266 microversion: 2.1 time: 0.155305 Aug 24 07:43:42.636480 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 237/487] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:42 2022] GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:43.192505 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-2653b238-fbe8-42c5-8ced-4bc8b973dbff tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:43.193114 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-2653b238-fbe8-42c5-8ced-4bc8b973dbff tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] [instance: 6821366f-ec0b-431d-86ef-393f5b0f728f] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:43.194130 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [req-effa3fc3-6ece-4c90-b041-a04a2b96ec99 req-47dae05d-9602-42b0-8203-4b57024657b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6821366f-ec0b-431d-86ef-393f5b0f728f", "name": "network-vif-plugged", "status": "completed", "tag": "2c221772-7ae4-4b1a-9144-6e18a1629c15"}]} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:43:43.199617 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2653b238-fbe8-42c5-8ced-4bc8b973dbff tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:43.200098 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2653b238-fbe8-42c5-8ced-4bc8b973dbff tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:43.200530 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2653b238-fbe8-42c5-8ced-4bc8b973dbff tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:43.201216 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2653b238-fbe8-42c5-8ced-4bc8b973dbff tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:43.201667 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2653b238-fbe8-42c5-8ced-4bc8b973dbff tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:43.202088 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2653b238-fbe8-42c5-8ced-4bc8b973dbff tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:43.203594 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-effa3fc3-6ece-4c90-b041-a04a2b96ec99 req-47dae05d-9602-42b0-8203-4b57024657b0 service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:43.204057 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-effa3fc3-6ece-4c90-b041-a04a2b96ec99 req-47dae05d-9602-42b0-8203-4b57024657b0 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:43.204476 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-effa3fc3-6ece-4c90-b041-a04a2b96ec99 req-47dae05d-9602-42b0-8203-4b57024657b0 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:43.232185 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.compute.server_external_events [req-effa3fc3-6ece-4c90-b041-a04a2b96ec99 req-47dae05d-9602-42b0-8203-4b57024657b0 service nova] Creating event network-vif-plugged:2c221772-7ae4-4b1a-9144-6e18a1629c15 for instance 6821366f-ec0b-431d-86ef-393f5b0f728f on hv-cinder-85427 Aug 24 07:43:43.237698 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [req-effa3fc3-6ece-4c90-b041-a04a2b96ec99 req-47dae05d-9602-42b0-8203-4b57024657b0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047469 Aug 24 07:43:43.238815 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 238/488] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:43:43.415099 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-2653b238-fbe8-42c5-8ced-4bc8b973dbff tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74594b3982264446b73d14bad3f46045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf922510f54d4d40ac00486394d67a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:43.423850 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-2653b238-fbe8-42c5-8ced-4bc8b973dbff tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] 10.222.0.42 "GET /compute/v2.1/servers/6821366f-ec0b-431d-86ef-393f5b0f728f" status: 200 len: 1318 microversion: 2.1 time: 0.235353 Aug 24 07:43:43.424620 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 251/489] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:43 2022] GET /compute/v2.1/servers/6821366f-ec0b-431d-86ef-393f5b0f728f => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:43.480630 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-07ab9a01-3731-4aae-9512-d37ddd98ffc6 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:43.481342 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-07ab9a01-3731-4aae-9512-d37ddd98ffc6 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:43.487643 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-07ab9a01-3731-4aae-9512-d37ddd98ffc6 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:43.488127 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-07ab9a01-3731-4aae-9512-d37ddd98ffc6 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:43.488559 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-07ab9a01-3731-4aae-9512-d37ddd98ffc6 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:43.489285 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-07ab9a01-3731-4aae-9512-d37ddd98ffc6 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:43.489732 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-07ab9a01-3731-4aae-9512-d37ddd98ffc6 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:43.490148 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-07ab9a01-3731-4aae-9512-d37ddd98ffc6 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:43.617047 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-07ab9a01-3731-4aae-9512-d37ddd98ffc6 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:43.624661 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-07ab9a01-3731-4aae-9512-d37ddd98ffc6 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 200 len: 1662 microversion: 2.1 time: 0.148502 Aug 24 07:43:43.625226 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 239/490] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:43 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 1662 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:43.656563 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-188eaf5b-ede1-44ed-9bd8-7e487bae740a tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:43.657164 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-188eaf5b-ede1-44ed-9bd8-7e487bae740a tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 6f20697e-980b-4345-addc-d4907757ff37] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:43.663783 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-188eaf5b-ede1-44ed-9bd8-7e487bae740a tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:43.664259 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-188eaf5b-ede1-44ed-9bd8-7e487bae740a tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:43.664687 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-188eaf5b-ede1-44ed-9bd8-7e487bae740a tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:43.665370 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-188eaf5b-ede1-44ed-9bd8-7e487bae740a tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:43.665818 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-188eaf5b-ede1-44ed-9bd8-7e487bae740a tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:43.666235 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-188eaf5b-ede1-44ed-9bd8-7e487bae740a tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:43.851461 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-188eaf5b-ede1-44ed-9bd8-7e487bae740a tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:43.859401 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-188eaf5b-ede1-44ed-9bd8-7e487bae740a tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37" status: 200 len: 1453 microversion: 2.1 time: 0.206600 Aug 24 07:43:43.859969 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 252/491] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:43 2022] GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37 => generated 1453 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:43.879706 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-5d6ec801-c7a0-40a2-a317-fb26fe29fc68 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:43.880343 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-5d6ec801-c7a0-40a2-a317-fb26fe29fc68 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 6f20697e-980b-4345-addc-d4907757ff37] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:43.886263 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5d6ec801-c7a0-40a2-a317-fb26fe29fc68 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:43.886771 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5d6ec801-c7a0-40a2-a317-fb26fe29fc68 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:43.887207 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5d6ec801-c7a0-40a2-a317-fb26fe29fc68 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:43.887895 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5d6ec801-c7a0-40a2-a317-fb26fe29fc68 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:43.888345 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5d6ec801-c7a0-40a2-a317-fb26fe29fc68 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:43.888770 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5d6ec801-c7a0-40a2-a317-fb26fe29fc68 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:44.017024 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-5d6ec801-c7a0-40a2-a317-fb26fe29fc68 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:44.025176 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-5d6ec801-c7a0-40a2-a317-fb26fe29fc68 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37" status: 200 len: 1453 microversion: 2.1 time: 0.149308 Aug 24 07:43:44.025739 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 240/492] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:43 2022] GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37 => generated 1453 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:44.445320 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-8dfc8e4d-2877-412a-8e83-c9ca86f1954a tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:44.445925 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-8dfc8e4d-2877-412a-8e83-c9ca86f1954a tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] [instance: 6821366f-ec0b-431d-86ef-393f5b0f728f] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:44.452631 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8dfc8e4d-2877-412a-8e83-c9ca86f1954a tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:44.453123 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8dfc8e4d-2877-412a-8e83-c9ca86f1954a tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:44.453672 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8dfc8e4d-2877-412a-8e83-c9ca86f1954a tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:44.454373 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8dfc8e4d-2877-412a-8e83-c9ca86f1954a tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:44.454902 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8dfc8e4d-2877-412a-8e83-c9ca86f1954a tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:44.455834 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8dfc8e4d-2877-412a-8e83-c9ca86f1954a tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:44.596380 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-8dfc8e4d-2877-412a-8e83-c9ca86f1954a tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74594b3982264446b73d14bad3f46045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf922510f54d4d40ac00486394d67a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:44.604163 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-8dfc8e4d-2877-412a-8e83-c9ca86f1954a tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] 10.222.0.42 "GET /compute/v2.1/servers/6821366f-ec0b-431d-86ef-393f5b0f728f" status: 200 len: 1318 microversion: 2.1 time: 0.162760 Aug 24 07:43:44.604809 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 253/493] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:44 2022] GET /compute/v2.1/servers/6821366f-ec0b-431d-86ef-393f5b0f728f => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:44.645319 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-3d6782b4-69d2-4752-80a3-8909d813a5be tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:44.645996 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-3d6782b4-69d2-4752-80a3-8909d813a5be tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:44.653345 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3d6782b4-69d2-4752-80a3-8909d813a5be tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:44.653825 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3d6782b4-69d2-4752-80a3-8909d813a5be tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:44.654252 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3d6782b4-69d2-4752-80a3-8909d813a5be tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:44.654973 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3d6782b4-69d2-4752-80a3-8909d813a5be tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:44.655427 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3d6782b4-69d2-4752-80a3-8909d813a5be tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:44.655847 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3d6782b4-69d2-4752-80a3-8909d813a5be tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:45.152993 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-3d6782b4-69d2-4752-80a3-8909d813a5be tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:45.161445 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-3d6782b4-69d2-4752-80a3-8909d813a5be tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 200 len: 1662 microversion: 2.1 time: 0.519942 Aug 24 07:43:45.162193 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 241/494] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:44 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 1662 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:45.624899 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-739b0317-a0b0-4774-b782-ce9ac81bc35b tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:45.625508 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-739b0317-a0b0-4774-b782-ce9ac81bc35b tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] [instance: 6821366f-ec0b-431d-86ef-393f5b0f728f] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:45.631931 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-739b0317-a0b0-4774-b782-ce9ac81bc35b tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:45.632413 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-739b0317-a0b0-4774-b782-ce9ac81bc35b tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:45.632844 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-739b0317-a0b0-4774-b782-ce9ac81bc35b tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:45.633528 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-739b0317-a0b0-4774-b782-ce9ac81bc35b tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:45.633979 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-739b0317-a0b0-4774-b782-ce9ac81bc35b tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:45.634405 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-739b0317-a0b0-4774-b782-ce9ac81bc35b tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:45.771968 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-739b0317-a0b0-4774-b782-ce9ac81bc35b tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74594b3982264446b73d14bad3f46045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf922510f54d4d40ac00486394d67a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:45.779917 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-739b0317-a0b0-4774-b782-ce9ac81bc35b tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] 10.222.0.42 "GET /compute/v2.1/servers/6821366f-ec0b-431d-86ef-393f5b0f728f" status: 200 len: 1506 microversion: 2.1 time: 0.159149 Aug 24 07:43:45.780926 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 254/495] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:45 2022] GET /compute/v2.1/servers/6821366f-ec0b-431d-86ef-393f5b0f728f => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:45.801693 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-3f644a4a-43ac-4b84-8f7c-9151956325dc tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ffcd1938-f0f2-486e-b16e-110b39d29131", "device": "/dev/sdb"}} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:43:45.804830 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-3f644a4a-43ac-4b84-8f7c-9151956325dc tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] [instance: 6821366f-ec0b-431d-86ef-393f5b0f728f] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:45.811167 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3f644a4a-43ac-4b84-8f7c-9151956325dc tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:45.811643 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3f644a4a-43ac-4b84-8f7c-9151956325dc tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:45.812175 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3f644a4a-43ac-4b84-8f7c-9151956325dc tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:45.812858 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3f644a4a-43ac-4b84-8f7c-9151956325dc tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:45.813310 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3f644a4a-43ac-4b84-8f7c-9151956325dc tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:45.813728 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3f644a4a-43ac-4b84-8f7c-9151956325dc tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:46.100785 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [req-10e9869c-188b-430d-a1d1-8338467e672c req-aa43b599-8b0e-4e26-a613-8f101552b887 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f20697e-980b-4345-addc-d4907757ff37", "tag": "599f3399-205e-4f58-a04f-6a46a51e0c0e"}]} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:43:46.101064 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-3f644a4a-43ac-4b84-8f7c-9151956325dc tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] 10.222.0.42 "POST /compute/v2.1/servers/6821366f-ec0b-431d-86ef-393f5b0f728f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.303243 Aug 24 07:43:46.108048 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 242/496] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Aug 24 07:43:45 2022] POST /compute/v2.1/servers/6821366f-ec0b-431d-86ef-393f5b0f728f/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:43:46.118487 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-10e9869c-188b-430d-a1d1-8338467e672c req-aa43b599-8b0e-4e26-a613-8f101552b887 service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:46.119076 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-10e9869c-188b-430d-a1d1-8338467e672c req-aa43b599-8b0e-4e26-a613-8f101552b887 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:46.119530 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-10e9869c-188b-430d-a1d1-8338467e672c req-aa43b599-8b0e-4e26-a613-8f101552b887 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:46.137124 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.compute.server_external_events [req-10e9869c-188b-430d-a1d1-8338467e672c req-aa43b599-8b0e-4e26-a613-8f101552b887 service nova] Creating event network-changed:599f3399-205e-4f58-a04f-6a46a51e0c0e for instance 6f20697e-980b-4345-addc-d4907757ff37 on hv-cinder-85427 Aug 24 07:43:46.156535 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [req-10e9869c-188b-430d-a1d1-8338467e672c req-aa43b599-8b0e-4e26-a613-8f101552b887 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059516 Aug 24 07:43:46.157332 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 255/497] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:43:46.207704 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-c8a5c53d-2f88-4781-bea9-4b12d1deab6f tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:43:46.209857 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-c8a5c53d-2f88-4781-bea9-4b12d1deab6f tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:46.226787 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c8a5c53d-2f88-4781-bea9-4b12d1deab6f tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:46.226787 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c8a5c53d-2f88-4781-bea9-4b12d1deab6f tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:46.230608 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c8a5c53d-2f88-4781-bea9-4b12d1deab6f tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:46.231838 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c8a5c53d-2f88-4781-bea9-4b12d1deab6f tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:46.235429 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c8a5c53d-2f88-4781-bea9-4b12d1deab6f tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:46.236314 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c8a5c53d-2f88-4781-bea9-4b12d1deab6f tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:46.436817 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-c8a5c53d-2f88-4781-bea9-4b12d1deab6f tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:43:46.446270 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-c8a5c53d-2f88-4781-bea9-4b12d1deab6f tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 200 len: 1666 microversion: 2.1 time: 0.261724 Aug 24 07:43:46.447265 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 243/498] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:43:46 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 1666 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:43:55.873480 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-3ff29e8b-fd4e-4bfe-a713-ad6fec59ec4b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1155f79-0776-4541-b841-27fe5250a86b"}} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:43:55.875918 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-3ff29e8b-fd4e-4bfe-a713-ad6fec59ec4b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:43:55.882500 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3ff29e8b-fd4e-4bfe-a713-ad6fec59ec4b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:55.883155 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3ff29e8b-fd4e-4bfe-a713-ad6fec59ec4b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:55.883583 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3ff29e8b-fd4e-4bfe-a713-ad6fec59ec4b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:55.884261 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3ff29e8b-fd4e-4bfe-a713-ad6fec59ec4b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:43:55.884704 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3ff29e8b-fd4e-4bfe-a713-ad6fec59ec4b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:43:55.885117 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3ff29e8b-fd4e-4bfe-a713-ad6fec59ec4b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:43:56.904936 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-3ff29e8b-fd4e-4bfe-a713-ad6fec59ec4b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "POST /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.036376 Aug 24 07:43:56.905604 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 256/499] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Aug 24 07:43:55 2022] POST /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de/os-volume_attachments => generated 194 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:44:04.421530 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-c3c154db-5647-448a-9ab0-91ba258150ec tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:44:04.424043 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-c3c154db-5647-448a-9ab0-91ba258150ec tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:04.426890 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_api:SELECT=93 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:04.427695 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:04.434669 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c3c154db-5647-448a-9ab0-91ba258150ec tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:04.435188 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c3c154db-5647-448a-9ab0-91ba258150ec tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:04.435627 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c3c154db-5647-448a-9ab0-91ba258150ec tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:04.436352 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c3c154db-5647-448a-9ab0-91ba258150ec tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:04.436769 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c3c154db-5647-448a-9ab0-91ba258150ec tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:04.437193 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c3c154db-5647-448a-9ab0-91ba258150ec tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:04.462032 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.objects.instance [None req-c3c154db-5647-448a-9ab0-91ba258150ec tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lazy-loading 'flavor' on Instance uuid 177a69e5-5a8e-48a8-99a8-928790a6a4de {{(pid=127113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:44:04.586248 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-c3c154db-5647-448a-9ab0-91ba258150ec tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "POST /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de/action" status: 200 len: 32 microversion: 2.1 time: 0.168485 Aug 24 07:44:04.587426 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 244/500] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 24 07:44:04 2022] POST /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de/action => generated 32 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 07:44:04.598554 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-8be86d88-2928-4042-a291-57d34ecd0d84 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:04.599372 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-8be86d88-2928-4042-a291-57d34ecd0d84 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:04.605916 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8be86d88-2928-4042-a291-57d34ecd0d84 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:04.606521 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8be86d88-2928-4042-a291-57d34ecd0d84 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:04.606980 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8be86d88-2928-4042-a291-57d34ecd0d84 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:04.607864 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8be86d88-2928-4042-a291-57d34ecd0d84 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:04.608589 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8be86d88-2928-4042-a291-57d34ecd0d84 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:04.609026 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8be86d88-2928-4042-a291-57d34ecd0d84 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:04.831847 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-8be86d88-2928-4042-a291-57d34ecd0d84 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:44:04.839950 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-8be86d88-2928-4042-a291-57d34ecd0d84 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de" status: 200 len: 1735 microversion: 2.1 time: 0.246749 Aug 24 07:44:04.840442 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 257/501] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:44:04 2022] GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de => generated 1735 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:05.483139 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-b7f14282-265a-4895-959f-a7bab02b82fe tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:05.483721 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-b7f14282-265a-4895-959f-a7bab02b82fe tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] [instance: 6821366f-ec0b-431d-86ef-393f5b0f728f] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:05.490364 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b7f14282-265a-4895-959f-a7bab02b82fe tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:05.490867 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b7f14282-265a-4895-959f-a7bab02b82fe tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:05.491298 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b7f14282-265a-4895-959f-a7bab02b82fe tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:05.491988 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b7f14282-265a-4895-959f-a7bab02b82fe tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:05.492430 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b7f14282-265a-4895-959f-a7bab02b82fe tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:05.492844 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b7f14282-265a-4895-959f-a7bab02b82fe tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:05.571528 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.objects.instance [None req-b7f14282-265a-4895-959f-a7bab02b82fe tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lazy-loading 'services' on Instance uuid 6821366f-ec0b-431d-86ef-393f5b0f728f {{(pid=127113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:44:05.642663 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-b7f14282-265a-4895-959f-a7bab02b82fe tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6821366f-ec0b-431d-86ef-393f5b0f728f/os-volume_attachments/ffcd1938-f0f2-486e-b16e-110b39d29131" status: 202 len: 0 microversion: 2.1 time: 0.164164 Aug 24 07:44:05.643270 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 245/502] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Aug 24 07:44:05 2022] DELETE /compute/v2.1/servers/6821366f-ec0b-431d-86ef-393f5b0f728f/os-volume_attachments/ffcd1938-f0f2-486e-b16e-110b39d29131 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 07:44:05.861224 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-99a49193-ed92-4a99-bd06-fe4ad774f792 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:05.861831 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-99a49193-ed92-4a99-bd06-fe4ad774f792 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:05.868230 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-99a49193-ed92-4a99-bd06-fe4ad774f792 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:05.868707 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-99a49193-ed92-4a99-bd06-fe4ad774f792 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:05.869135 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-99a49193-ed92-4a99-bd06-fe4ad774f792 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:05.869815 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-99a49193-ed92-4a99-bd06-fe4ad774f792 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:05.870272 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-99a49193-ed92-4a99-bd06-fe4ad774f792 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:05.870727 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-99a49193-ed92-4a99-bd06-fe4ad774f792 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:05.994983 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-99a49193-ed92-4a99-bd06-fe4ad774f792 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:44:06.003529 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-99a49193-ed92-4a99-bd06-fe4ad774f792 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de" status: 200 len: 1735 microversion: 2.1 time: 0.145662 Aug 24 07:44:06.004112 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 258/503] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:44:05 2022] GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:06.758957 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-a3fc1251-999c-4acd-a48d-1baec7beac5e tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:06.759564 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-a3fc1251-999c-4acd-a48d-1baec7beac5e tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] [instance: 6821366f-ec0b-431d-86ef-393f5b0f728f] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:06.765748 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a3fc1251-999c-4acd-a48d-1baec7beac5e tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:06.766216 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a3fc1251-999c-4acd-a48d-1baec7beac5e tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:06.766640 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a3fc1251-999c-4acd-a48d-1baec7beac5e tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:06.767347 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a3fc1251-999c-4acd-a48d-1baec7beac5e tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:06.767790 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a3fc1251-999c-4acd-a48d-1baec7beac5e tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:06.768202 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a3fc1251-999c-4acd-a48d-1baec7beac5e tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:06.792454 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-a3fc1251-999c-4acd-a48d-1baec7beac5e tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] [instance: 6821366f-ec0b-431d-86ef-393f5b0f728f] Going to try to terminate instance {{(pid=127113) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 07:44:06.869353 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-a3fc1251-999c-4acd-a48d-1baec7beac5e tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6821366f-ec0b-431d-86ef-393f5b0f728f" status: 204 len: 0 microversion: 2.1 time: 0.114459 Aug 24 07:44:06.870291 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 246/504] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 24 07:44:06 2022] DELETE /compute/v2.1/servers/6821366f-ec0b-431d-86ef-393f5b0f728f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:06.878941 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-60a181ce-f46c-4495-8b21-dde75925c64a tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:06.879549 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-60a181ce-f46c-4495-8b21-dde75925c64a tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] [instance: 6821366f-ec0b-431d-86ef-393f5b0f728f] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:06.885844 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-60a181ce-f46c-4495-8b21-dde75925c64a tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:06.886322 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-60a181ce-f46c-4495-8b21-dde75925c64a tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:06.886776 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-60a181ce-f46c-4495-8b21-dde75925c64a tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:06.887460 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-60a181ce-f46c-4495-8b21-dde75925c64a tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:06.887909 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-60a181ce-f46c-4495-8b21-dde75925c64a tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:06.888330 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-60a181ce-f46c-4495-8b21-dde75925c64a tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:07.013158 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-60a181ce-f46c-4495-8b21-dde75925c64a tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74594b3982264446b73d14bad3f46045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf922510f54d4d40ac00486394d67a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:44:07.020951 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-60a181ce-f46c-4495-8b21-dde75925c64a tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] 10.222.0.42 "GET /compute/v2.1/servers/6821366f-ec0b-431d-86ef-393f5b0f728f" status: 200 len: 1512 microversion: 2.1 time: 0.146427 Aug 24 07:44:07.021504 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 259/505] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:44:06 2022] GET /compute/v2.1/servers/6821366f-ec0b-431d-86ef-393f5b0f728f => generated 1512 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:07.024787 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-c06bafcf-0176-44b5-a6f6-49af5a1396df tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:07.025480 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-c06bafcf-0176-44b5-a6f6-49af5a1396df tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:07.031324 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c06bafcf-0176-44b5-a6f6-49af5a1396df tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:07.031803 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c06bafcf-0176-44b5-a6f6-49af5a1396df tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:07.032237 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c06bafcf-0176-44b5-a6f6-49af5a1396df tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:07.032921 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c06bafcf-0176-44b5-a6f6-49af5a1396df tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:07.033401 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c06bafcf-0176-44b5-a6f6-49af5a1396df tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:07.033823 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c06bafcf-0176-44b5-a6f6-49af5a1396df tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:07.161037 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-c06bafcf-0176-44b5-a6f6-49af5a1396df tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:44:07.169488 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-c06bafcf-0176-44b5-a6f6-49af5a1396df tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de" status: 200 len: 1735 microversion: 2.1 time: 0.148969 Aug 24 07:44:07.170045 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 247/506] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:44:07 2022] GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:44:08.041096 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-48064670-534d-486a-8df3-6bdf00b5d482 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:08.041939 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-48064670-534d-486a-8df3-6bdf00b5d482 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] [instance: 6821366f-ec0b-431d-86ef-393f5b0f728f] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:08.048411 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-48064670-534d-486a-8df3-6bdf00b5d482 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:08.048880 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-48064670-534d-486a-8df3-6bdf00b5d482 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:08.049312 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-48064670-534d-486a-8df3-6bdf00b5d482 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:08.050559 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-48064670-534d-486a-8df3-6bdf00b5d482 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:08.051034 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-48064670-534d-486a-8df3-6bdf00b5d482 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:08.051449 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-48064670-534d-486a-8df3-6bdf00b5d482 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:08.181925 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-48064670-534d-486a-8df3-6bdf00b5d482 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74594b3982264446b73d14bad3f46045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf922510f54d4d40ac00486394d67a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:44:08.189647 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-48064670-534d-486a-8df3-6bdf00b5d482 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] 10.222.0.42 "GET /compute/v2.1/servers/6821366f-ec0b-431d-86ef-393f5b0f728f" status: 200 len: 1512 microversion: 2.1 time: 0.152369 Aug 24 07:44:08.190209 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 260/507] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:44:08 2022] GET /compute/v2.1/servers/6821366f-ec0b-431d-86ef-393f5b0f728f => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:08.190437 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-0e5a98a6-93f0-4ece-a7c3-3d5c140a31e7 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:08.191061 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-0e5a98a6-93f0-4ece-a7c3-3d5c140a31e7 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:08.197406 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0e5a98a6-93f0-4ece-a7c3-3d5c140a31e7 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:08.197878 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0e5a98a6-93f0-4ece-a7c3-3d5c140a31e7 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:08.198300 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0e5a98a6-93f0-4ece-a7c3-3d5c140a31e7 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:08.199007 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0e5a98a6-93f0-4ece-a7c3-3d5c140a31e7 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:08.199450 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0e5a98a6-93f0-4ece-a7c3-3d5c140a31e7 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:08.199870 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0e5a98a6-93f0-4ece-a7c3-3d5c140a31e7 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:08.329638 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-0e5a98a6-93f0-4ece-a7c3-3d5c140a31e7 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:44:08.337714 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-0e5a98a6-93f0-4ece-a7c3-3d5c140a31e7 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de" status: 200 len: 1735 microversion: 2.1 time: 0.151042 Aug 24 07:44:08.338284 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 248/508] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:44:08 2022] GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:44:09.209889 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-176e6d24-900c-4e31-9483-ec456bb32062 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:09.210465 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-176e6d24-900c-4e31-9483-ec456bb32062 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] [instance: 6821366f-ec0b-431d-86ef-393f5b0f728f] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:09.216753 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-176e6d24-900c-4e31-9483-ec456bb32062 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:09.217224 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-176e6d24-900c-4e31-9483-ec456bb32062 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:09.217648 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-176e6d24-900c-4e31-9483-ec456bb32062 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:09.218326 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-176e6d24-900c-4e31-9483-ec456bb32062 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:09.218806 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-176e6d24-900c-4e31-9483-ec456bb32062 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:09.219240 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-176e6d24-900c-4e31-9483-ec456bb32062 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:09.290022 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-176e6d24-900c-4e31-9483-ec456bb32062 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74594b3982264446b73d14bad3f46045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf922510f54d4d40ac00486394d67a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:44:09.298603 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-176e6d24-900c-4e31-9483-ec456bb32062 tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] 10.222.0.42 "GET /compute/v2.1/servers/6821366f-ec0b-431d-86ef-393f5b0f728f" status: 200 len: 1470 microversion: 2.1 time: 0.092763 Aug 24 07:44:09.300006 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 261/509] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:44:09 2022] GET /compute/v2.1/servers/6821366f-ec0b-431d-86ef-393f5b0f728f => generated 1470 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:44:09.359601 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-458a469a-03c9-40be-94bc-70652774af57 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:09.360207 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-458a469a-03c9-40be-94bc-70652774af57 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:09.367449 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-458a469a-03c9-40be-94bc-70652774af57 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:09.367932 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-458a469a-03c9-40be-94bc-70652774af57 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:09.368361 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-458a469a-03c9-40be-94bc-70652774af57 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:09.369145 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-458a469a-03c9-40be-94bc-70652774af57 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:09.369825 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-458a469a-03c9-40be-94bc-70652774af57 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:09.370241 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-458a469a-03c9-40be-94bc-70652774af57 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:09.376284 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [req-22f5b5f2-6b10-41db-8711-a443d4967b53 req-254b6c4b-4481-4535-a2da-86ff1ddcf24c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6821366f-ec0b-431d-86ef-393f5b0f728f", "name": "network-vif-deleted", "tag": "2c221772-7ae4-4b1a-9144-6e18a1629c15"}]} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:44:09.387693 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-22f5b5f2-6b10-41db-8711-a443d4967b53 req-254b6c4b-4481-4535-a2da-86ff1ddcf24c service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:09.388452 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-22f5b5f2-6b10-41db-8711-a443d4967b53 req-254b6c4b-4481-4535-a2da-86ff1ddcf24c service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:09.389070 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-22f5b5f2-6b10-41db-8711-a443d4967b53 req-254b6c4b-4481-4535-a2da-86ff1ddcf24c service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:09.401274 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.compute.server_external_events [req-22f5b5f2-6b10-41db-8711-a443d4967b53 req-254b6c4b-4481-4535-a2da-86ff1ddcf24c service nova] Creating event network-vif-deleted:2c221772-7ae4-4b1a-9144-6e18a1629c15 for instance 6821366f-ec0b-431d-86ef-393f5b0f728f on hv-cinder-85427 Aug 24 07:44:09.406630 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [req-22f5b5f2-6b10-41db-8711-a443d4967b53 req-254b6c4b-4481-4535-a2da-86ff1ddcf24c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034719 Aug 24 07:44:09.407341 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 262/510] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:44:09.514741 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-458a469a-03c9-40be-94bc-70652774af57 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:44:09.522978 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-458a469a-03c9-40be-94bc-70652774af57 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de" status: 200 len: 1735 microversion: 2.1 time: 0.167493 Aug 24 07:44:09.523535 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 249/511] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:44:09 2022] GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:10.322485 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-226782ca-22dc-4268-b5f6-99d5c7436f5d tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:10.323086 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-226782ca-22dc-4268-b5f6-99d5c7436f5d tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] [instance: 6821366f-ec0b-431d-86ef-393f5b0f728f] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:10.324978 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_api:SELECT=34 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:10.330304 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-226782ca-22dc-4268-b5f6-99d5c7436f5d tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:10.331385 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-226782ca-22dc-4268-b5f6-99d5c7436f5d tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:10.331813 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-226782ca-22dc-4268-b5f6-99d5c7436f5d tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:10.332496 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-226782ca-22dc-4268-b5f6-99d5c7436f5d tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:10.332940 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-226782ca-22dc-4268-b5f6-99d5c7436f5d tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:10.333354 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-226782ca-22dc-4268-b5f6-99d5c7436f5d tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:10.346358 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.wsgi [None req-226782ca-22dc-4268-b5f6-99d5c7436f5d tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] HTTP exception thrown: Instance 6821366f-ec0b-431d-86ef-393f5b0f728f could not be found. Aug 24 07:44:10.348089 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-226782ca-22dc-4268-b5f6-99d5c7436f5d tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Request method failure captured: Aug 24 07:44:10.348089 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: request: GET /compute/v2.1/servers/6821366f-ec0b-431d-86ef-393f5b0f728f HTTP/1.1 Aug 24 07:44:10.348089 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept: application/json Aug 24 07:44:10.348089 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept-Encoding: identity Aug 24 07:44:10.348089 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Connection: close Aug 24 07:44:10.348089 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Length: 0 Aug 24 07:44:10.348089 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Type: application/json Aug 24 07:44:10.348089 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Host: 10.222.0.42 Aug 24 07:44:10.348089 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Openstack-System-Scope: None Aug 24 07:44:10.348089 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: User-Agent: python-urllib3/1.26.11 Aug 24 07:44:10.348089 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Auth-Token: gAAAAABjBdYciPoQpvfDOrS3F5GIgjEV8TG8w1hh9eyilnPxemjR5t0uHqtNbHUV9vIX1jlNZICq0fG7uoXfirqURg6PIX6DtYxIKM5JZcaJ9fEBuPa6E3MJNqLaA_t8lxf3HpkxKQCTW1Bbq3NJAvprRhfYuQo3KFp2asHoRiXgAgsNPA_-jh8 Aug 24 07:44:10.348089 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Id: None Aug 24 07:44:10.348089 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Name: None Aug 24 07:44:10.348089 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Identity-Status: Confirmed Aug 24 07:44:10.348089 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Is-Admin-Project: True Aug 24 07:44:10.348089 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Id: default Aug 24 07:44:10.348089 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Name: Default Aug 24 07:44:10.348089 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Id: bf922510f54d4d40ac00486394d67a7a Aug 24 07:44:10.348089 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1782416949 Aug 24 07:44:10.348089 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Role: reader,member Aug 24 07:44:10.348089 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Roles: reader,member Aug 24 07:44:10.349663 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bf922510f54d4d40ac00486394d67a7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bf922510f54d4d40ac00486394d67a7a", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bf922510f54d4d40ac00486394d67a7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bf922510f54d4d40ac00486394d67a7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:44:10.349663 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant: tempest-VolumesSnapshotTestJSON-1782416949 Aug 24 07:44:10.349663 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Id: bf922510f54d4d40ac00486394d67a7a Aug 24 07:44:10.349663 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1782416949 Aug 24 07:44:10.349663 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User: tempest-VolumesSnapshotTestJSON-1782416949-project Aug 24 07:44:10.349663 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Id: default Aug 24 07:44:10.349663 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Name: Default Aug 24 07:44:10.349663 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Id: 74594b3982264446b73d14bad3f46045 Aug 24 07:44:10.349663 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Name: tempest-VolumesSnapshotTestJSON-1782416949-project Aug 24 07:44:10.349663 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: method: > Aug 24 07:44:10.349663 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: exception: Instance 6821366f-ec0b-431d-86ef-393f5b0f728f could not be found. Aug 24 07:44:10.349663 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: action_args: {'id': '6821366f-ec0b-431d-86ef-393f5b0f728f'} Aug 24 07:44:10.350458 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:44:10.350458 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:44:10.350458 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:44:10.350458 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:44:10.350458 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:44:10.350458 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:44:10.350458 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:44:10.350458 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:44:10.350458 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:44:10.350458 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:44:10.350458 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6821366f-ec0b-431d-86ef-393f5b0f728f could not be found. Aug 24 07:44:10.350458 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:44:10.350458 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:44:10.350458 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:44:10.350458 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:44:10.350458 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:44:10.350458 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:44:10.350458 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:44:10.350458 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:44:10.350458 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:44:10.351681 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:44:10.351681 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 07:44:10.351681 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 07:44:10.351681 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:44:10.351681 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:44:10.351681 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:44:10.351681 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:44:10.351681 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6821366f-ec0b-431d-86ef-393f5b0f728f could not be found. Aug 24 07:44:10.351681 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:44:10.351681 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:44:10.351681 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:44:10.351681 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:44:10.351681 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:44:10.351681 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:44:10.351681 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:44:10.351681 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:44:10.351681 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6821366f-ec0b-431d-86ef-393f5b0f728f could not be found. Aug 24 07:44:10.351681 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:44:10.352824 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-226782ca-22dc-4268-b5f6-99d5c7436f5d tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] Returning 404 to user: Instance 6821366f-ec0b-431d-86ef-393f5b0f728f could not be found. {{(pid=127114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:44:10.352824 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-226782ca-22dc-4268-b5f6-99d5c7436f5d tempest-VolumesSnapshotTestJSON-1782416949 tempest-VolumesSnapshotTestJSON-1782416949-project] 10.222.0.42 "GET /compute/v2.1/servers/6821366f-ec0b-431d-86ef-393f5b0f728f" status: 404 len: 111 microversion: 2.1 time: 0.031727 Aug 24 07:44:10.352824 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 263/512] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:44:10 2022] GET /compute/v2.1/servers/6821366f-ec0b-431d-86ef-393f5b0f728f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:44:10.543830 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-12bba8b1-4136-4128-8fc0-c89dc8ecf1b9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:10.544574 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-12bba8b1-4136-4128-8fc0-c89dc8ecf1b9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:10.551488 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-12bba8b1-4136-4128-8fc0-c89dc8ecf1b9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:10.551972 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-12bba8b1-4136-4128-8fc0-c89dc8ecf1b9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:10.552404 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-12bba8b1-4136-4128-8fc0-c89dc8ecf1b9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:10.554057 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-12bba8b1-4136-4128-8fc0-c89dc8ecf1b9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:10.554517 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-12bba8b1-4136-4128-8fc0-c89dc8ecf1b9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:10.554967 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-12bba8b1-4136-4128-8fc0-c89dc8ecf1b9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:10.699349 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-12bba8b1-4136-4128-8fc0-c89dc8ecf1b9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:44:10.707561 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-12bba8b1-4136-4128-8fc0-c89dc8ecf1b9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de" status: 200 len: 1735 microversion: 2.1 time: 0.167580 Aug 24 07:44:10.708129 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 250/513] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:44:10 2022] GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:11.729437 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-854705ae-8607-465a-b740-ba9c34d19484 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:11.730098 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-854705ae-8607-465a-b740-ba9c34d19484 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:11.736438 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-854705ae-8607-465a-b740-ba9c34d19484 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:11.737013 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-854705ae-8607-465a-b740-ba9c34d19484 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:11.737521 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-854705ae-8607-465a-b740-ba9c34d19484 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:11.738878 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-854705ae-8607-465a-b740-ba9c34d19484 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:11.739336 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-854705ae-8607-465a-b740-ba9c34d19484 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:11.739762 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-854705ae-8607-465a-b740-ba9c34d19484 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:11.886979 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-854705ae-8607-465a-b740-ba9c34d19484 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:44:11.895172 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-854705ae-8607-465a-b740-ba9c34d19484 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de" status: 200 len: 1735 microversion: 2.1 time: 0.169673 Aug 24 07:44:11.895731 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 264/514] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:44:11 2022] GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:44:12.916605 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-426e9a74-f5ab-4518-994d-3ae4eb8f550c tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:12.917203 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-426e9a74-f5ab-4518-994d-3ae4eb8f550c tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:12.923470 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-426e9a74-f5ab-4518-994d-3ae4eb8f550c tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:12.923943 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-426e9a74-f5ab-4518-994d-3ae4eb8f550c tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:12.924367 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-426e9a74-f5ab-4518-994d-3ae4eb8f550c tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:12.925036 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-426e9a74-f5ab-4518-994d-3ae4eb8f550c tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:12.925481 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-426e9a74-f5ab-4518-994d-3ae4eb8f550c tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:12.926445 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-426e9a74-f5ab-4518-994d-3ae4eb8f550c tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:13.050071 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-426e9a74-f5ab-4518-994d-3ae4eb8f550c tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:44:13.059147 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-426e9a74-f5ab-4518-994d-3ae4eb8f550c tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de" status: 200 len: 1735 microversion: 2.1 time: 0.146313 Aug 24 07:44:13.059703 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 251/515] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:44:12 2022] GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:14.082526 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-5455567c-20d5-4bcd-b904-b4c66895e9c8 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:14.083182 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-5455567c-20d5-4bcd-b904-b4c66895e9c8 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:14.089568 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5455567c-20d5-4bcd-b904-b4c66895e9c8 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:14.090042 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5455567c-20d5-4bcd-b904-b4c66895e9c8 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:14.090476 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5455567c-20d5-4bcd-b904-b4c66895e9c8 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:14.091186 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5455567c-20d5-4bcd-b904-b4c66895e9c8 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:14.091641 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5455567c-20d5-4bcd-b904-b4c66895e9c8 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:14.092062 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5455567c-20d5-4bcd-b904-b4c66895e9c8 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:14.095932 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:14.224268 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-5455567c-20d5-4bcd-b904-b4c66895e9c8 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:44:14.232553 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-5455567c-20d5-4bcd-b904-b4c66895e9c8 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de" status: 200 len: 1735 microversion: 2.1 time: 0.155341 Aug 24 07:44:14.233111 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 265/516] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:44:14 2022] GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:15.252590 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-b2c5b2c5-0a88-4313-9c85-691b0e739186 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:15.253246 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-b2c5b2c5-0a88-4313-9c85-691b0e739186 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:15.259710 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b2c5b2c5-0a88-4313-9c85-691b0e739186 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:15.260195 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b2c5b2c5-0a88-4313-9c85-691b0e739186 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:15.260626 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b2c5b2c5-0a88-4313-9c85-691b0e739186 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:15.261378 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b2c5b2c5-0a88-4313-9c85-691b0e739186 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:15.261834 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b2c5b2c5-0a88-4313-9c85-691b0e739186 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:15.262260 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b2c5b2c5-0a88-4313-9c85-691b0e739186 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:15.391736 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-b2c5b2c5-0a88-4313-9c85-691b0e739186 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:44:15.400675 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-b2c5b2c5-0a88-4313-9c85-691b0e739186 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de" status: 200 len: 1735 microversion: 2.1 time: 0.151982 Aug 24 07:44:15.401276 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 252/517] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:44:15 2022] GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:16.421399 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-12a87d80-35a9-40a7-a586-b964648323e4 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:16.422001 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-12a87d80-35a9-40a7-a586-b964648323e4 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:16.429704 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-12a87d80-35a9-40a7-a586-b964648323e4 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:16.430171 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-12a87d80-35a9-40a7-a586-b964648323e4 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:16.430660 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-12a87d80-35a9-40a7-a586-b964648323e4 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:16.431398 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-12a87d80-35a9-40a7-a586-b964648323e4 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:16.431844 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-12a87d80-35a9-40a7-a586-b964648323e4 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:16.432289 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-12a87d80-35a9-40a7-a586-b964648323e4 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:16.559726 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-12a87d80-35a9-40a7-a586-b964648323e4 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:44:16.567742 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-12a87d80-35a9-40a7-a586-b964648323e4 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de" status: 200 len: 1735 microversion: 2.1 time: 0.150332 Aug 24 07:44:16.568296 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 266/518] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:44:16 2022] GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:44:17.591177 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-18b7edc9-44d3-4325-aafa-b7f91f900d82 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:17.591888 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-18b7edc9-44d3-4325-aafa-b7f91f900d82 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:17.598220 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-18b7edc9-44d3-4325-aafa-b7f91f900d82 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:17.599285 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-18b7edc9-44d3-4325-aafa-b7f91f900d82 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:17.599712 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-18b7edc9-44d3-4325-aafa-b7f91f900d82 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:17.600391 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-18b7edc9-44d3-4325-aafa-b7f91f900d82 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:17.600832 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-18b7edc9-44d3-4325-aafa-b7f91f900d82 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:17.601261 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-18b7edc9-44d3-4325-aafa-b7f91f900d82 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:17.755522 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-18b7edc9-44d3-4325-aafa-b7f91f900d82 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:44:17.763532 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-18b7edc9-44d3-4325-aafa-b7f91f900d82 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de" status: 200 len: 1735 microversion: 2.1 time: 0.176233 Aug 24 07:44:17.764184 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 253/519] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:44:17 2022] GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:18.785624 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-f9060ceb-9e11-4161-bf08-d919b6ee2b34 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:18.786817 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-f9060ceb-9e11-4161-bf08-d919b6ee2b34 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:18.793354 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f9060ceb-9e11-4161-bf08-d919b6ee2b34 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:18.799713 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f9060ceb-9e11-4161-bf08-d919b6ee2b34 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:18.799713 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f9060ceb-9e11-4161-bf08-d919b6ee2b34 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:18.799713 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f9060ceb-9e11-4161-bf08-d919b6ee2b34 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:18.799713 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f9060ceb-9e11-4161-bf08-d919b6ee2b34 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:18.800092 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f9060ceb-9e11-4161-bf08-d919b6ee2b34 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:18.927520 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-f9060ceb-9e11-4161-bf08-d919b6ee2b34 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:44:18.936368 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-f9060ceb-9e11-4161-bf08-d919b6ee2b34 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de" status: 200 len: 1735 microversion: 2.1 time: 0.154532 Aug 24 07:44:18.944049 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 267/520] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:44:18 2022] GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:19.957108 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-0e51f2d4-70da-4106-8201-51709dacd23f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:19.958342 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-0e51f2d4-70da-4106-8201-51709dacd23f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:19.964858 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0e51f2d4-70da-4106-8201-51709dacd23f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:19.965334 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0e51f2d4-70da-4106-8201-51709dacd23f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:19.965762 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0e51f2d4-70da-4106-8201-51709dacd23f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:19.966474 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0e51f2d4-70da-4106-8201-51709dacd23f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:19.966947 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0e51f2d4-70da-4106-8201-51709dacd23f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:19.967369 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0e51f2d4-70da-4106-8201-51709dacd23f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:20.093860 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-0e51f2d4-70da-4106-8201-51709dacd23f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:44:20.101847 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-0e51f2d4-70da-4106-8201-51709dacd23f tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de" status: 200 len: 1735 microversion: 2.1 time: 0.148608 Aug 24 07:44:20.102400 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 254/521] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:44:19 2022] GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:21.122574 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-50b759cd-a764-4456-a3b1-47fff32fa674 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:21.123199 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-50b759cd-a764-4456-a3b1-47fff32fa674 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:21.130100 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-50b759cd-a764-4456-a3b1-47fff32fa674 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:21.130569 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-50b759cd-a764-4456-a3b1-47fff32fa674 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:21.131027 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-50b759cd-a764-4456-a3b1-47fff32fa674 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:21.131700 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-50b759cd-a764-4456-a3b1-47fff32fa674 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:21.132145 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-50b759cd-a764-4456-a3b1-47fff32fa674 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:21.132555 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-50b759cd-a764-4456-a3b1-47fff32fa674 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:21.261331 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-50b759cd-a764-4456-a3b1-47fff32fa674 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:44:21.269548 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-50b759cd-a764-4456-a3b1-47fff32fa674 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de" status: 200 len: 1735 microversion: 2.1 time: 0.150714 Aug 24 07:44:21.270601 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 268/522] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:44:21 2022] GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:22.290665 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-edaf515f-6303-4135-911c-bb7cac32fe03 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:22.291509 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-edaf515f-6303-4135-911c-bb7cac32fe03 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:22.298318 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-edaf515f-6303-4135-911c-bb7cac32fe03 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:22.298840 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-edaf515f-6303-4135-911c-bb7cac32fe03 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:22.299277 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-edaf515f-6303-4135-911c-bb7cac32fe03 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:22.299969 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-edaf515f-6303-4135-911c-bb7cac32fe03 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:22.300417 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-edaf515f-6303-4135-911c-bb7cac32fe03 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:22.300837 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-edaf515f-6303-4135-911c-bb7cac32fe03 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:22.430815 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-edaf515f-6303-4135-911c-bb7cac32fe03 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:44:22.438915 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-edaf515f-6303-4135-911c-bb7cac32fe03 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de" status: 200 len: 1735 microversion: 2.1 time: 0.152147 Aug 24 07:44:22.439476 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 255/523] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:44:22 2022] GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:23.461349 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-fe899cc8-eb06-4b24-9d2b-7f3342ed3b49 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:23.461977 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-fe899cc8-eb06-4b24-9d2b-7f3342ed3b49 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:23.468803 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fe899cc8-eb06-4b24-9d2b-7f3342ed3b49 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:23.469281 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fe899cc8-eb06-4b24-9d2b-7f3342ed3b49 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:23.469710 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fe899cc8-eb06-4b24-9d2b-7f3342ed3b49 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:23.470393 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fe899cc8-eb06-4b24-9d2b-7f3342ed3b49 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:23.471218 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fe899cc8-eb06-4b24-9d2b-7f3342ed3b49 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:23.471648 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fe899cc8-eb06-4b24-9d2b-7f3342ed3b49 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:23.650537 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-fe899cc8-eb06-4b24-9d2b-7f3342ed3b49 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:44:23.658818 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-fe899cc8-eb06-4b24-9d2b-7f3342ed3b49 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de" status: 200 len: 1735 microversion: 2.1 time: 0.203001 Aug 24 07:44:23.659599 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 269/524] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:44:23 2022] GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de => generated 1735 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:24.680923 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-b41a5805-9803-4bec-b633-cce116fa8f14 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:24.681558 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-b41a5805-9803-4bec-b633-cce116fa8f14 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:24.687932 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b41a5805-9803-4bec-b633-cce116fa8f14 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:24.688406 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b41a5805-9803-4bec-b633-cce116fa8f14 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:24.688834 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b41a5805-9803-4bec-b633-cce116fa8f14 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:24.689519 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b41a5805-9803-4bec-b633-cce116fa8f14 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:24.689970 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b41a5805-9803-4bec-b633-cce116fa8f14 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:24.690385 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b41a5805-9803-4bec-b633-cce116fa8f14 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:24.694393 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:24.824674 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-b41a5805-9803-4bec-b633-cce116fa8f14 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:44:24.834326 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-b41a5805-9803-4bec-b633-cce116fa8f14 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de" status: 200 len: 1735 microversion: 2.1 time: 0.158215 Aug 24 07:44:24.835072 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 256/525] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:44:24 2022] GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:25.855310 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-39cf2f74-cabc-480d-b088-fa51d2858a04 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:25.855921 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-39cf2f74-cabc-480d-b088-fa51d2858a04 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:25.862964 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-39cf2f74-cabc-480d-b088-fa51d2858a04 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:25.863950 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-39cf2f74-cabc-480d-b088-fa51d2858a04 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:25.864383 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-39cf2f74-cabc-480d-b088-fa51d2858a04 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:25.865059 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-39cf2f74-cabc-480d-b088-fa51d2858a04 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:25.865508 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-39cf2f74-cabc-480d-b088-fa51d2858a04 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:25.865923 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-39cf2f74-cabc-480d-b088-fa51d2858a04 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:25.998127 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-39cf2f74-cabc-480d-b088-fa51d2858a04 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:44:26.006206 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-39cf2f74-cabc-480d-b088-fa51d2858a04 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de" status: 200 len: 1715 microversion: 2.1 time: 0.154848 Aug 24 07:44:26.006783 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 270/526] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:44:25 2022] GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de => generated 1715 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:26.119735 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-5a992615-f088-49f5-8437-d74818d7e9fb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:26.120232 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-5a992615-f088-49f5-8437-d74818d7e9fb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:26.126623 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5a992615-f088-49f5-8437-d74818d7e9fb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:26.127131 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5a992615-f088-49f5-8437-d74818d7e9fb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:26.127563 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5a992615-f088-49f5-8437-d74818d7e9fb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:26.128239 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5a992615-f088-49f5-8437-d74818d7e9fb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:26.128688 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5a992615-f088-49f5-8437-d74818d7e9fb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:26.129611 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5a992615-f088-49f5-8437-d74818d7e9fb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:26.208767 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.wsgi [None req-5a992615-f088-49f5-8437-d74818d7e9fb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] HTTP exception thrown: Cannot 'detach_volume' instance 177a69e5-5a8e-48a8-99a8-928790a6a4de while it is in vm_state rescued Aug 24 07:44:26.210356 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-5a992615-f088-49f5-8437-d74818d7e9fb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Request method failure captured: Aug 24 07:44:26.210356 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: request: DELETE /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de/os-volume_attachments/a1155f79-0776-4541-b841-27fe5250a86b HTTP/1.1 Aug 24 07:44:26.210356 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept: application/json Aug 24 07:44:26.210356 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept-Encoding: identity Aug 24 07:44:26.210356 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Connection: close Aug 24 07:44:26.210356 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Length: 0 Aug 24 07:44:26.210356 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Type: application/json Aug 24 07:44:26.210356 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Host: 10.222.0.42 Aug 24 07:44:26.210356 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Openstack-System-Scope: None Aug 24 07:44:26.210356 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: User-Agent: python-urllib3/1.26.11 Aug 24 07:44:26.210356 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Auth-Token: gAAAAABjBdXj3OPdwVwNOikGz1pZEgQOCeh4GEqP5ntGxH9tZbilOI8irB2hmt3_ZpPS8CXIWEa2XHNjlUSveY2TpFHTN1ywO6y85GK4OQMHI4fYrZV7Il0xWKACBF1PBAEg2tFw9XsIk_TQrLA7G9okeYuatkKWc1A69fCtYrVWLZK-735LZbU Aug 24 07:44:26.210356 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Id: None Aug 24 07:44:26.210356 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Name: None Aug 24 07:44:26.210356 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Identity-Status: Confirmed Aug 24 07:44:26.210356 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Is-Admin-Project: True Aug 24 07:44:26.210356 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Id: default Aug 24 07:44:26.210356 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Name: Default Aug 24 07:44:26.210356 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Id: d5672bdc355c4f63885138bd9c7f3497 Aug 24 07:44:26.210356 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1449296042 Aug 24 07:44:26.210356 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Role: reader,member Aug 24 07:44:26.210356 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Roles: reader,member Aug 24 07:44:26.211895 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d5672bdc355c4f63885138bd9c7f3497"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d5672bdc355c4f63885138bd9c7f3497", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d5672bdc355c4f63885138bd9c7f3497"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d5672bdc355c4f63885138bd9c7f3497"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:44:26.211895 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1449296042 Aug 24 07:44:26.211895 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Id: d5672bdc355c4f63885138bd9c7f3497 Aug 24 07:44:26.211895 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1449296042 Aug 24 07:44:26.211895 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User: tempest-ServerRescueNegativeTestJSON-1449296042-project Aug 24 07:44:26.211895 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Id: default Aug 24 07:44:26.211895 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Name: Default Aug 24 07:44:26.211895 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Id: ea609a2504e64f6f9380061080976a6e Aug 24 07:44:26.211895 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1449296042-project Aug 24 07:44:26.211895 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: method: > Aug 24 07:44:26.211895 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: exception: Cannot 'detach_volume' instance 177a69e5-5a8e-48a8-99a8-928790a6a4de while it is in vm_state rescued Aug 24 07:44:26.212659 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: action_args: {'server_id': '177a69e5-5a8e-48a8-99a8-928790a6a4de', 'id': 'a1155f79-0776-4541-b841-27fe5250a86b'} Aug 24 07:44:26.212659 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:44:26.212659 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:44:26.212659 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 07:44:26.212659 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 07:44:26.212659 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 07:44:26.212659 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 07:44:26.212659 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 07:44:26.212659 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 07:44:26.212659 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 177a69e5-5a8e-48a8-99a8-928790a6a4de in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 24 07:44:26.212659 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:44:26.212659 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:44:26.212659 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:44:26.212659 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:44:26.212659 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:44:26.212659 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:44:26.212659 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:44:26.212659 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:44:26.212659 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:44:26.212659 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:44:26.213885 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 24 07:44:26.213885 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 07:44:26.213885 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 07:44:26.213885 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 07:44:26.213885 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 177a69e5-5a8e-48a8-99a8-928790a6a4de while it is in vm_state rescued Aug 24 07:44:26.213885 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:44:26.213885 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:44:26.213885 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:44:26.213885 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:44:26.213885 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:44:26.213885 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:44:26.213885 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:44:26.213885 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:44:26.213885 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 177a69e5-5a8e-48a8-99a8-928790a6a4de while it is in vm_state rescued Aug 24 07:44:26.213885 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:44:26.213885 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-5a992615-f088-49f5-8437-d74818d7e9fb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Returning 409 to user: Cannot 'detach_volume' instance 177a69e5-5a8e-48a8-99a8-928790a6a4de while it is in vm_state rescued {{(pid=127113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:44:26.214931 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-5a992615-f088-49f5-8437-d74818d7e9fb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "DELETE /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de/os-volume_attachments/a1155f79-0776-4541-b841-27fe5250a86b" status: 409 len: 152 microversion: 2.1 time: 0.096070 Aug 24 07:44:26.214931 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 257/527] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Aug 24 07:44:26 2022] DELETE /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de/os-volume_attachments/a1155f79-0776-4541-b841-27fe5250a86b => generated 152 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 07:44:26.220869 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-0dab409c-6a24-4396-a0db-3e6ec30cafcb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:44:26.221398 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-0dab409c-6a24-4396-a0db-3e6ec30cafcb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:26.227249 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0dab409c-6a24-4396-a0db-3e6ec30cafcb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:26.227725 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0dab409c-6a24-4396-a0db-3e6ec30cafcb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:26.228156 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0dab409c-6a24-4396-a0db-3e6ec30cafcb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:26.228834 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0dab409c-6a24-4396-a0db-3e6ec30cafcb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:26.229290 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0dab409c-6a24-4396-a0db-3e6ec30cafcb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:26.229711 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0dab409c-6a24-4396-a0db-3e6ec30cafcb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:26.292936 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-0dab409c-6a24-4396-a0db-3e6ec30cafcb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "POST /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de/action" status: 202 len: 0 microversion: 2.1 time: 0.075717 Aug 24 07:44:26.296677 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 271/528] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 24 07:44:26 2022] POST /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 07:44:26.301651 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-aec04ae3-2467-4400-a793-67bd9126fda0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:26.302527 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-aec04ae3-2467-4400-a793-67bd9126fda0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:26.316194 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-aec04ae3-2467-4400-a793-67bd9126fda0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:26.317197 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-aec04ae3-2467-4400-a793-67bd9126fda0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:26.317631 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-aec04ae3-2467-4400-a793-67bd9126fda0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:26.318540 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-aec04ae3-2467-4400-a793-67bd9126fda0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:26.319046 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-aec04ae3-2467-4400-a793-67bd9126fda0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:26.319481 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-aec04ae3-2467-4400-a793-67bd9126fda0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:26.454223 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-aec04ae3-2467-4400-a793-67bd9126fda0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:44:26.462264 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-aec04ae3-2467-4400-a793-67bd9126fda0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de" status: 200 len: 1723 microversion: 2.1 time: 0.164426 Aug 24 07:44:26.462850 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 258/529] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:44:26 2022] GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:27.484230 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-60ab5010-4a93-4117-8f41-eb51a7788a11 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:27.484865 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-60ab5010-4a93-4117-8f41-eb51a7788a11 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:27.490949 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-60ab5010-4a93-4117-8f41-eb51a7788a11 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:27.491423 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-60ab5010-4a93-4117-8f41-eb51a7788a11 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:27.491848 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-60ab5010-4a93-4117-8f41-eb51a7788a11 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:27.492521 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-60ab5010-4a93-4117-8f41-eb51a7788a11 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:27.492965 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-60ab5010-4a93-4117-8f41-eb51a7788a11 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:27.493376 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-60ab5010-4a93-4117-8f41-eb51a7788a11 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:27.619580 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-60ab5010-4a93-4117-8f41-eb51a7788a11 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:44:27.627579 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-60ab5010-4a93-4117-8f41-eb51a7788a11 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de" status: 200 len: 1723 microversion: 2.1 time: 0.148396 Aug 24 07:44:27.628129 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 272/530] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:44:27 2022] GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:28.649205 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-b4b2c717-a45e-4b56-b27c-aa4acff26c5a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:28.649811 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-b4b2c717-a45e-4b56-b27c-aa4acff26c5a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:28.656271 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b4b2c717-a45e-4b56-b27c-aa4acff26c5a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:28.656745 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b4b2c717-a45e-4b56-b27c-aa4acff26c5a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:28.657178 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b4b2c717-a45e-4b56-b27c-aa4acff26c5a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:28.657852 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b4b2c717-a45e-4b56-b27c-aa4acff26c5a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:28.658299 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b4b2c717-a45e-4b56-b27c-aa4acff26c5a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:28.658744 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b4b2c717-a45e-4b56-b27c-aa4acff26c5a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:28.786269 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-b4b2c717-a45e-4b56-b27c-aa4acff26c5a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:44:28.794277 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-b4b2c717-a45e-4b56-b27c-aa4acff26c5a tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de" status: 200 len: 1723 microversion: 2.1 time: 0.148935 Aug 24 07:44:28.794862 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 259/531] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:44:28 2022] GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:29.815416 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-180f860b-1b52-4725-9340-ee9c2ff3eb9e tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:29.816022 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-180f860b-1b52-4725-9340-ee9c2ff3eb9e tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:29.822445 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-180f860b-1b52-4725-9340-ee9c2ff3eb9e tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:29.822950 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-180f860b-1b52-4725-9340-ee9c2ff3eb9e tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:29.823385 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-180f860b-1b52-4725-9340-ee9c2ff3eb9e tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:29.824079 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-180f860b-1b52-4725-9340-ee9c2ff3eb9e tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:29.824516 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-180f860b-1b52-4725-9340-ee9c2ff3eb9e tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:29.824940 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-180f860b-1b52-4725-9340-ee9c2ff3eb9e tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:29.952891 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-180f860b-1b52-4725-9340-ee9c2ff3eb9e tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:44:29.961101 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-180f860b-1b52-4725-9340-ee9c2ff3eb9e tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de" status: 200 len: 1729 microversion: 2.1 time: 0.149543 Aug 24 07:44:29.961664 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 273/532] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:44:29 2022] GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:29.981467 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-e887e097-2500-4786-88b6-224813a9ea4d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:29.981970 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-e887e097-2500-4786-88b6-224813a9ea4d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:29.988006 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e887e097-2500-4786-88b6-224813a9ea4d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:29.989071 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e887e097-2500-4786-88b6-224813a9ea4d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:29.989494 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e887e097-2500-4786-88b6-224813a9ea4d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:29.990165 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e887e097-2500-4786-88b6-224813a9ea4d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:29.990609 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e887e097-2500-4786-88b6-224813a9ea4d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:29.991045 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e887e097-2500-4786-88b6-224813a9ea4d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:30.068291 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-e887e097-2500-4786-88b6-224813a9ea4d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090582 Aug 24 07:44:30.068886 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 260/533] 10.222.0.42 () {58 vars in 1275 bytes} [Wed Aug 24 07:44:29 2022] GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:44:30.933810 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [req-2075d1bc-5554-4f02-9c1d-d75fde4fc069 req-d7825877-ab83-433c-9839-1267cfa3a753 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "177a69e5-5a8e-48a8-99a8-928790a6a4de", "tag": "4c3c99fa-7ec3-487c-bf8f-3f7c8ee8b4ff"}]} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:44:30.944043 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-2075d1bc-5554-4f02-9c1d-d75fde4fc069 req-d7825877-ab83-433c-9839-1267cfa3a753 service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:30.944710 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-2075d1bc-5554-4f02-9c1d-d75fde4fc069 req-d7825877-ab83-433c-9839-1267cfa3a753 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:30.945237 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-2075d1bc-5554-4f02-9c1d-d75fde4fc069 req-d7825877-ab83-433c-9839-1267cfa3a753 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:30.961261 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.compute.server_external_events [req-2075d1bc-5554-4f02-9c1d-d75fde4fc069 req-d7825877-ab83-433c-9839-1267cfa3a753 service nova] Creating event network-changed:4c3c99fa-7ec3-487c-bf8f-3f7c8ee8b4ff for instance 177a69e5-5a8e-48a8-99a8-928790a6a4de on hv-cinder-85427 Aug 24 07:44:30.963988 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [req-2075d1bc-5554-4f02-9c1d-d75fde4fc069 req-d7825877-ab83-433c-9839-1267cfa3a753 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033781 Aug 24 07:44:30.964658 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 274/534] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:44:32.979888 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [req-4d1bafe1-5bfd-429b-bfa2-9e3016a30e30 req-703192fe-4dad-4f02-ab59-4e29d45ab8de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "177a69e5-5a8e-48a8-99a8-928790a6a4de", "tag": "4c3c99fa-7ec3-487c-bf8f-3f7c8ee8b4ff"}]} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:44:32.989798 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-4d1bafe1-5bfd-429b-bfa2-9e3016a30e30 req-703192fe-4dad-4f02-ab59-4e29d45ab8de service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:32.990271 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-4d1bafe1-5bfd-429b-bfa2-9e3016a30e30 req-703192fe-4dad-4f02-ab59-4e29d45ab8de service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:32.990731 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-4d1bafe1-5bfd-429b-bfa2-9e3016a30e30 req-703192fe-4dad-4f02-ab59-4e29d45ab8de service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:33.001878 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.compute.server_external_events [req-4d1bafe1-5bfd-429b-bfa2-9e3016a30e30 req-703192fe-4dad-4f02-ab59-4e29d45ab8de service nova] Creating event network-changed:4c3c99fa-7ec3-487c-bf8f-3f7c8ee8b4ff for instance 177a69e5-5a8e-48a8-99a8-928790a6a4de on hv-cinder-85427 Aug 24 07:44:33.007374 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [req-4d1bafe1-5bfd-429b-bfa2-9e3016a30e30 req-703192fe-4dad-4f02-ab59-4e29d45ab8de service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031749 Aug 24 07:44:33.008139 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 261/535] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:44:37.722288 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-5eba7878-a99e-4bdd-a65c-59fca41d2058 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:37.725260 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-5eba7878-a99e-4bdd-a65c-59fca41d2058 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:37.731764 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5eba7878-a99e-4bdd-a65c-59fca41d2058 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:37.732250 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5eba7878-a99e-4bdd-a65c-59fca41d2058 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:37.732688 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5eba7878-a99e-4bdd-a65c-59fca41d2058 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:37.733393 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5eba7878-a99e-4bdd-a65c-59fca41d2058 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:37.733850 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5eba7878-a99e-4bdd-a65c-59fca41d2058 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:37.734276 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5eba7878-a99e-4bdd-a65c-59fca41d2058 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:37.764953 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-5eba7878-a99e-4bdd-a65c-59fca41d2058 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047569 Aug 24 07:44:37.766254 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 275/536] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 24 07:44:37 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 07:44:37.843668 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-42dfc9a4-2a82-48f4-bee1-4017f16483f3 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:37.844440 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-42dfc9a4-2a82-48f4-bee1-4017f16483f3 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:37.847322 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:37.853752 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-42dfc9a4-2a82-48f4-bee1-4017f16483f3 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:37.855295 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-42dfc9a4-2a82-48f4-bee1-4017f16483f3 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:37.855781 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-42dfc9a4-2a82-48f4-bee1-4017f16483f3 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:37.856574 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-42dfc9a4-2a82-48f4-bee1-4017f16483f3 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:37.857043 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-42dfc9a4-2a82-48f4-bee1-4017f16483f3 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:37.857477 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-42dfc9a4-2a82-48f4-bee1-4017f16483f3 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:37.883413 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-42dfc9a4-2a82-48f4-bee1-4017f16483f3 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Going to try to terminate instance {{(pid=127113) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 07:44:37.968126 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-42dfc9a4-2a82-48f4-bee1-4017f16483f3 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "DELETE /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 204 len: 0 microversion: 2.1 time: 0.128718 Aug 24 07:44:37.969898 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 262/537] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 24 07:44:37 2022] DELETE /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:37.978024 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-a906bde4-ce8f-40a0-8d1d-cf36830b966e tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:37.978738 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-a906bde4-ce8f-40a0-8d1d-cf36830b966e tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:37.984622 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a906bde4-ce8f-40a0-8d1d-cf36830b966e tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:37.985104 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a906bde4-ce8f-40a0-8d1d-cf36830b966e tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:37.985538 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a906bde4-ce8f-40a0-8d1d-cf36830b966e tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:37.986223 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a906bde4-ce8f-40a0-8d1d-cf36830b966e tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:37.986671 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a906bde4-ce8f-40a0-8d1d-cf36830b966e tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:37.987112 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a906bde4-ce8f-40a0-8d1d-cf36830b966e tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:38.171399 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-a906bde4-ce8f-40a0-8d1d-cf36830b966e tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:44:38.180624 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-a906bde4-ce8f-40a0-8d1d-cf36830b966e tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 200 len: 1672 microversion: 2.1 time: 0.206419 Aug 24 07:44:38.182828 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 276/538] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:44:37 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 1672 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:39.205613 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-6e8c8965-092f-4b3d-a88c-cfd045668058 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:39.206321 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-6e8c8965-092f-4b3d-a88c-cfd045668058 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:39.213527 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6e8c8965-092f-4b3d-a88c-cfd045668058 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:39.214013 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6e8c8965-092f-4b3d-a88c-cfd045668058 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:39.214446 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6e8c8965-092f-4b3d-a88c-cfd045668058 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:39.215167 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6e8c8965-092f-4b3d-a88c-cfd045668058 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:39.215624 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6e8c8965-092f-4b3d-a88c-cfd045668058 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:39.216046 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6e8c8965-092f-4b3d-a88c-cfd045668058 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:39.685099 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-6e8c8965-092f-4b3d-a88c-cfd045668058 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:44:39.697181 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-6e8c8965-092f-4b3d-a88c-cfd045668058 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 200 len: 1672 microversion: 2.1 time: 0.495219 Aug 24 07:44:39.699282 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 263/539] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:44:39 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 1672 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:40.718502 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-e02a680b-85c6-4115-aa8e-9ae0c957cdd8 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:40.719691 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-e02a680b-85c6-4115-aa8e-9ae0c957cdd8 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:40.725942 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_api:SELECT=28 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:40.728165 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e02a680b-85c6-4115-aa8e-9ae0c957cdd8 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:40.729331 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e02a680b-85c6-4115-aa8e-9ae0c957cdd8 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:40.729331 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e02a680b-85c6-4115-aa8e-9ae0c957cdd8 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:40.730577 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e02a680b-85c6-4115-aa8e-9ae0c957cdd8 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:40.731135 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e02a680b-85c6-4115-aa8e-9ae0c957cdd8 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:40.731721 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e02a680b-85c6-4115-aa8e-9ae0c957cdd8 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:40.934955 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-e02a680b-85c6-4115-aa8e-9ae0c957cdd8 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:44:40.948680 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-e02a680b-85c6-4115-aa8e-9ae0c957cdd8 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 200 len: 1672 microversion: 2.1 time: 0.233652 Aug 24 07:44:40.949848 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 277/540] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:44:40 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 1672 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:41.397662 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [req-4b578d49-47a0-45e0-964e-5db51720ef89 req-63ada680-9cda-4a26-93e9-fc0a00e7caf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63a5cb56-fccf-4fbe-be10-b637c616539c", "name": "network-vif-deleted", "tag": "14fb5185-a6ab-4b56-b947-d37fd7e7479a"}]} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:44:41.416645 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-4b578d49-47a0-45e0-964e-5db51720ef89 req-63ada680-9cda-4a26-93e9-fc0a00e7caf7 service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:41.418492 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-4b578d49-47a0-45e0-964e-5db51720ef89 req-63ada680-9cda-4a26-93e9-fc0a00e7caf7 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:41.434822 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-4b578d49-47a0-45e0-964e-5db51720ef89 req-63ada680-9cda-4a26-93e9-fc0a00e7caf7 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:41.505476 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.compute.server_external_events [req-4b578d49-47a0-45e0-964e-5db51720ef89 req-63ada680-9cda-4a26-93e9-fc0a00e7caf7 service nova] Creating event network-vif-deleted:14fb5185-a6ab-4b56-b947-d37fd7e7479a for instance 63a5cb56-fccf-4fbe-be10-b637c616539c on hv-cinder-85427 Aug 24 07:44:41.545012 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [req-4b578d49-47a0-45e0-964e-5db51720ef89 req-63ada680-9cda-4a26-93e9-fc0a00e7caf7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148770 Aug 24 07:44:41.547212 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 264/541] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:44:41.972810 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-eb12c75f-d7e9-4742-943a-e374bb02a9a2 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:41.974001 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-eb12c75f-d7e9-4742-943a-e374bb02a9a2 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:41.990192 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-eb12c75f-d7e9-4742-943a-e374bb02a9a2 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:41.990712 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-eb12c75f-d7e9-4742-943a-e374bb02a9a2 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:41.991161 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-eb12c75f-d7e9-4742-943a-e374bb02a9a2 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:42.000197 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-eb12c75f-d7e9-4742-943a-e374bb02a9a2 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:42.000754 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-eb12c75f-d7e9-4742-943a-e374bb02a9a2 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:42.002566 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-eb12c75f-d7e9-4742-943a-e374bb02a9a2 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:42.100933 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-eb12c75f-d7e9-4742-943a-e374bb02a9a2 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:42.103213 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-eb12c75f-d7e9-4742-943a-e374bb02a9a2 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:42.103952 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-eb12c75f-d7e9-4742-943a-e374bb02a9a2 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:42.105415 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.objects.instance [None req-eb12c75f-d7e9-4742-943a-e374bb02a9a2 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lazy-loading 'fault' on Instance uuid 63a5cb56-fccf-4fbe-be10-b637c616539c {{(pid=127114) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:44:42.235874 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-eb12c75f-d7e9-4742-943a-e374bb02a9a2 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:44:42.245688 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-eb12c75f-d7e9-4742-943a-e374bb02a9a2 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 200 len: 1326 microversion: 2.1 time: 0.277269 Aug 24 07:44:42.251303 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 278/542] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:44:41 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 1326 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:42.540321 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-5150e68c-236b-4c93-ac78-3351438540ce tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:42.540914 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-5150e68c-236b-4c93-ac78-3351438540ce tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: 851572e6-8dda-401b-aab8-58fbe54a2b31] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:42.556852 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5150e68c-236b-4c93-ac78-3351438540ce tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:42.560924 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5150e68c-236b-4c93-ac78-3351438540ce tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:42.561390 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5150e68c-236b-4c93-ac78-3351438540ce tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:42.562144 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5150e68c-236b-4c93-ac78-3351438540ce tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:42.571597 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5150e68c-236b-4c93-ac78-3351438540ce tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:42.572388 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5150e68c-236b-4c93-ac78-3351438540ce tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:42.666554 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-5150e68c-236b-4c93-ac78-3351438540ce tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31/ips" status: 200 len: 149 microversion: 2.1 time: 0.130363 Aug 24 07:44:42.671346 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 265/543] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Aug 24 07:44:42 2022] GET /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31/ips => generated 149 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:44:42.683819 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-7134bec1-76f3-4e50-a27a-620e177ba9f3 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a4fcf7f-d359-41bd-a444-1c1efc4cd791"}} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:44:42.686413 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-7134bec1-76f3-4e50-a27a-620e177ba9f3 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: 851572e6-8dda-401b-aab8-58fbe54a2b31] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:42.706210 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7134bec1-76f3-4e50-a27a-620e177ba9f3 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:42.706805 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7134bec1-76f3-4e50-a27a-620e177ba9f3 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:42.707265 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7134bec1-76f3-4e50-a27a-620e177ba9f3 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:42.709989 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7134bec1-76f3-4e50-a27a-620e177ba9f3 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:42.710892 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7134bec1-76f3-4e50-a27a-620e177ba9f3 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:42.712361 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7134bec1-76f3-4e50-a27a-620e177ba9f3 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:42.914506 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.wsgi [None req-7134bec1-76f3-4e50-a27a-620e177ba9f3 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] HTTP exception thrown: Invalid volume: volume 7a4fcf7f-d359-41bd-a444-1c1efc4cd791 is already attached to instances: d596e142-eb18-49d4-8eb8-bec422282059 Aug 24 07:44:42.918188 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-7134bec1-76f3-4e50-a27a-620e177ba9f3 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Request method failure captured: Aug 24 07:44:42.918188 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: request: POST /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31/os-volume_attachments HTTP/1.1 Aug 24 07:44:42.918188 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept: application/json Aug 24 07:44:42.918188 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept-Encoding: identity Aug 24 07:44:42.918188 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Connection: close Aug 24 07:44:42.918188 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Length: 74 Aug 24 07:44:42.918188 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Type: application/json Aug 24 07:44:42.918188 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Host: 10.222.0.42 Aug 24 07:44:42.918188 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Openstack-System-Scope: None Aug 24 07:44:42.918188 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: User-Agent: python-urllib3/1.26.11 Aug 24 07:44:42.918188 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Auth-Token: gAAAAABjBdYobzFKkpFZErKGYQQ6C-XEh7i9OW8ojTbqxPVr74lckpRiFaze-efBQslsaQSX_M9uiYyghTqG7Fg_jrM-qOMOyzErIrVcNm0xIs9NgJg7VzKqJCSA-yXxsyHfCdfoLwTQ2cusI7TmXO58zoZh7YF2Ykkf3m7e8LiRBBQiO6NdfF4 Aug 24 07:44:42.918188 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Id: None Aug 24 07:44:42.918188 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Name: None Aug 24 07:44:42.918188 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Identity-Status: Confirmed Aug 24 07:44:42.918188 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Is-Admin-Project: True Aug 24 07:44:42.918188 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Id: default Aug 24 07:44:42.918188 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Name: Default Aug 24 07:44:42.918188 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Id: af5acb73124c485aa87e60b4e5d4f6d4 Aug 24 07:44:42.918188 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Name: tempest-AttachVolumeNegativeTest-1077633228 Aug 24 07:44:42.918188 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Role: reader,member Aug 24 07:44:42.918188 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Roles: reader,member Aug 24 07:44:42.919816 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af5acb73124c485aa87e60b4e5d4f6d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_af5acb73124c485aa87e60b4e5d4f6d4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af5acb73124c485aa87e60b4e5d4f6d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/af5acb73124c485aa87e60b4e5d4f6d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:44:42.919816 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant: tempest-AttachVolumeNegativeTest-1077633228 Aug 24 07:44:42.919816 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Id: af5acb73124c485aa87e60b4e5d4f6d4 Aug 24 07:44:42.919816 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1077633228 Aug 24 07:44:42.919816 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User: tempest-AttachVolumeNegativeTest-1077633228-project Aug 24 07:44:42.919816 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Id: default Aug 24 07:44:42.919816 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Name: Default Aug 24 07:44:42.919816 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Id: f594c9344b2c472ba33ceef87ec88a0b Aug 24 07:44:42.919816 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Name: tempest-AttachVolumeNegativeTest-1077633228-project Aug 24 07:44:42.919816 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Aug 24 07:44:42.919816 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: {"volumeAttachment": {"volumeId": "7a4fcf7f-d359-41bd-a444-1c1efc4cd791"}} Aug 24 07:44:42.919816 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: method: > Aug 24 07:44:42.920872 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: exception: Invalid volume: volume 7a4fcf7f-d359-41bd-a444-1c1efc4cd791 is already attached to instances: d596e142-eb18-49d4-8eb8-bec422282059 Aug 24 07:44:42.920872 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: action_args: {'server_id': '851572e6-8dda-401b-aab8-58fbe54a2b31', 'body': {'volumeAttachment': {'volumeId': '7a4fcf7f-d359-41bd-a444-1c1efc4cd791'}}} Aug 24 07:44:42.920872 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:44:42.920872 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:44:42.920872 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 07:44:42.920872 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 07:44:42.920872 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 07:44:42.920872 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 07:44:42.920872 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 07:44:42.920872 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 07:44:42.920872 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 07:44:42.920872 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 07:44:42.920872 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 07:44:42.920872 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 07:44:42.920872 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7a4fcf7f-d359-41bd-a444-1c1efc4cd791 is already attached to instances: d596e142-eb18-49d4-8eb8-bec422282059 Aug 24 07:44:42.920872 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:44:42.920872 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:44:42.920872 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:44:42.920872 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:44:42.922202 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:44:42.922202 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:44:42.922202 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:44:42.922202 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:44:42.922202 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:44:42.922202 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:44:42.922202 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 07:44:42.922202 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 07:44:42.922202 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 07:44:42.922202 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 07:44:42.922202 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 07:44:42.922202 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 07:44:42.922202 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 07:44:42.922202 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 07:44:42.922202 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7a4fcf7f-d359-41bd-a444-1c1efc4cd791 is already attached to instances: d596e142-eb18-49d4-8eb8-bec422282059 Aug 24 07:44:42.922202 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:44:42.922202 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:44:42.922202 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:44:42.922202 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:44:42.922202 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:44:42.923657 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:44:42.923657 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:44:42.923657 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:44:42.923657 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7a4fcf7f-d359-41bd-a444-1c1efc4cd791 is already attached to instances: d596e142-eb18-49d4-8eb8-bec422282059 Aug 24 07:44:42.923657 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:44:42.923657 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-7134bec1-76f3-4e50-a27a-620e177ba9f3 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Returning 400 to user: Invalid volume: volume 7a4fcf7f-d359-41bd-a444-1c1efc4cd791 is already attached to instances: d596e142-eb18-49d4-8eb8-bec422282059 {{(pid=127114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:44:42.924148 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-7134bec1-76f3-4e50-a27a-620e177ba9f3 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "POST /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.244298 Aug 24 07:44:42.929236 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 279/544] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Aug 24 07:44:42 2022] POST /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31/os-volume_attachments => generated 174 bytes in 250 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 07:44:42.933976 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-f6d3488a-9591-4066-bf20-e2a7196fef6d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:42.934669 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-f6d3488a-9591-4066-bf20-e2a7196fef6d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: 851572e6-8dda-401b-aab8-58fbe54a2b31] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:42.942963 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f6d3488a-9591-4066-bf20-e2a7196fef6d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:42.951508 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f6d3488a-9591-4066-bf20-e2a7196fef6d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:42.952221 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f6d3488a-9591-4066-bf20-e2a7196fef6d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:42.953093 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f6d3488a-9591-4066-bf20-e2a7196fef6d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:42.955502 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f6d3488a-9591-4066-bf20-e2a7196fef6d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:42.956197 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f6d3488a-9591-4066-bf20-e2a7196fef6d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:43.013959 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-f6d3488a-9591-4066-bf20-e2a7196fef6d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: 851572e6-8dda-401b-aab8-58fbe54a2b31] Going to try to terminate instance {{(pid=127113) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 07:44:43.154475 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-f6d3488a-9591-4066-bf20-e2a7196fef6d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "DELETE /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31" status: 204 len: 0 microversion: 2.1 time: 0.224036 Aug 24 07:44:43.155102 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 266/545] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 24 07:44:42 2022] DELETE /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 07:44:43.163196 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-0fdb6303-ad9b-4f02-8da8-6e4a2d46f1b0 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:43.163783 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-0fdb6303-ad9b-4f02-8da8-6e4a2d46f1b0 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: 851572e6-8dda-401b-aab8-58fbe54a2b31] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:43.172814 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0fdb6303-ad9b-4f02-8da8-6e4a2d46f1b0 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:43.173355 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0fdb6303-ad9b-4f02-8da8-6e4a2d46f1b0 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:43.173785 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0fdb6303-ad9b-4f02-8da8-6e4a2d46f1b0 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:43.174492 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0fdb6303-ad9b-4f02-8da8-6e4a2d46f1b0 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:43.174973 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0fdb6303-ad9b-4f02-8da8-6e4a2d46f1b0 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:43.176065 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0fdb6303-ad9b-4f02-8da8-6e4a2d46f1b0 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:43.270247 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-a9d0f0b5-a68a-4474-9b45-e4e15ef90f56 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:43.271168 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-a9d0f0b5-a68a-4474-9b45-e4e15ef90f56 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:43.282127 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a9d0f0b5-a68a-4474-9b45-e4e15ef90f56 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:43.288514 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a9d0f0b5-a68a-4474-9b45-e4e15ef90f56 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:43.289224 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a9d0f0b5-a68a-4474-9b45-e4e15ef90f56 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:43.293978 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a9d0f0b5-a68a-4474-9b45-e4e15ef90f56 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:43.294599 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a9d0f0b5-a68a-4474-9b45-e4e15ef90f56 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:43.295169 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a9d0f0b5-a68a-4474-9b45-e4e15ef90f56 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:43.333885 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.wsgi [None req-a9d0f0b5-a68a-4474-9b45-e4e15ef90f56 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] HTTP exception thrown: Instance 63a5cb56-fccf-4fbe-be10-b637c616539c could not be found. Aug 24 07:44:43.342765 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-a9d0f0b5-a68a-4474-9b45-e4e15ef90f56 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Request method failure captured: Aug 24 07:44:43.342765 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: request: GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c HTTP/1.1 Aug 24 07:44:43.342765 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept: application/json Aug 24 07:44:43.342765 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept-Encoding: identity Aug 24 07:44:43.342765 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Connection: close Aug 24 07:44:43.342765 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Length: 0 Aug 24 07:44:43.342765 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Type: application/json Aug 24 07:44:43.342765 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Host: 10.222.0.42 Aug 24 07:44:43.342765 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Openstack-System-Scope: None Aug 24 07:44:43.342765 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: User-Agent: python-urllib3/1.26.11 Aug 24 07:44:43.342765 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Auth-Token: gAAAAABjBdXbRtskbQhOYObAHeZbK0sYucBoh7btNygp0xhMBdo5krTvqePibR8j4N6RRXC__H4GHozQyHcP9FJb5i_cDdVAB1VHwI9Wkt13q_acNeJCMzKhq3rgo9EKtnKV2XHS_HW9Bb7oejzyFpKgCkMHLTzYdFr249MEYEMPshat84Z8zvY Aug 24 07:44:43.342765 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Id: None Aug 24 07:44:43.342765 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Name: None Aug 24 07:44:43.342765 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Identity-Status: Confirmed Aug 24 07:44:43.342765 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Is-Admin-Project: True Aug 24 07:44:43.342765 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Id: default Aug 24 07:44:43.342765 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Name: Default Aug 24 07:44:43.342765 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Id: 3e9b29dbfd404c008fe871808d41e059 Aug 24 07:44:43.342765 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Name: tempest-AttachVolumeTestJSON-1817292289 Aug 24 07:44:43.342765 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Role: reader,member Aug 24 07:44:43.342765 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Roles: reader,member Aug 24 07:44:43.344085 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3e9b29dbfd404c008fe871808d41e059"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3e9b29dbfd404c008fe871808d41e059", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3e9b29dbfd404c008fe871808d41e059"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3e9b29dbfd404c008fe871808d41e059"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:44:43.344085 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant: tempest-AttachVolumeTestJSON-1817292289 Aug 24 07:44:43.344085 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Id: 3e9b29dbfd404c008fe871808d41e059 Aug 24 07:44:43.344085 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1817292289 Aug 24 07:44:43.344085 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User: tempest-AttachVolumeTestJSON-1817292289-project Aug 24 07:44:43.344085 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Id: default Aug 24 07:44:43.344085 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Name: Default Aug 24 07:44:43.344085 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Id: 072548785a38488db94ee05dfbf8c8ec Aug 24 07:44:43.344085 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Name: tempest-AttachVolumeTestJSON-1817292289-project Aug 24 07:44:43.344085 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: method: > Aug 24 07:44:43.344085 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: exception: Instance 63a5cb56-fccf-4fbe-be10-b637c616539c could not be found. Aug 24 07:44:43.344085 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: action_args: {'id': '63a5cb56-fccf-4fbe-be10-b637c616539c'} Aug 24 07:44:43.344832 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:44:43.344832 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:44:43.344832 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:44:43.344832 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:44:43.344832 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:44:43.344832 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:44:43.344832 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:44:43.344832 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:44:43.344832 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:44:43.344832 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:44:43.344832 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63a5cb56-fccf-4fbe-be10-b637c616539c could not be found. Aug 24 07:44:43.344832 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:44:43.344832 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:44:43.344832 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:44:43.344832 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:44:43.344832 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:44:43.344832 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:44:43.344832 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:44:43.344832 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:44:43.344832 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:44:43.349393 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:44:43.349393 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 07:44:43.349393 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 07:44:43.349393 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:44:43.349393 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:44:43.349393 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:44:43.349393 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:44:43.349393 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63a5cb56-fccf-4fbe-be10-b637c616539c could not be found. Aug 24 07:44:43.349393 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:44:43.349393 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:44:43.349393 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:44:43.349393 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:44:43.349393 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:44:43.349393 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:44:43.349393 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:44:43.349393 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:44:43.349393 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63a5cb56-fccf-4fbe-be10-b637c616539c could not be found. Aug 24 07:44:43.349393 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:44:43.351878 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-a9d0f0b5-a68a-4474-9b45-e4e15ef90f56 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Returning 404 to user: Instance 63a5cb56-fccf-4fbe-be10-b637c616539c could not be found. {{(pid=127113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:44:43.351878 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-a9d0f0b5-a68a-4474-9b45-e4e15ef90f56 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 404 len: 111 microversion: 2.1 time: 0.080966 Aug 24 07:44:43.351878 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 267/546] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:44:43 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:44:43.370580 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-1706bde1-8c06-4370-9448-b7ae1e7c16f5 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '.version_select at 0x7faf5bde0ca0>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:43.451456 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-1706bde1-8c06-4370-9448-b7ae1e7c16f5 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-342720773" status: 202 len: 0 microversion: 2.1 time: 0.077271 Aug 24 07:44:43.455666 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 268/547] 10.222.0.42 () {58 vars in 1218 bytes} [Wed Aug 24 07:44:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-342720773 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 07:44:43.494467 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-0fdb6303-ad9b-4f02-8da8-6e4a2d46f1b0 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:44:43.505092 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-0fdb6303-ad9b-4f02-8da8-6e4a2d46f1b0 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31" status: 200 len: 1680 microversion: 2.1 time: 0.345658 Aug 24 07:44:43.505684 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 280/548] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:44:43 2022] GET /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31 => generated 1680 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:44.539475 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-ea8d6edf-8dd8-498a-847f-c5ec32fedd9e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:44.540105 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-ea8d6edf-8dd8-498a-847f-c5ec32fedd9e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: 851572e6-8dda-401b-aab8-58fbe54a2b31] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:44.547136 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ea8d6edf-8dd8-498a-847f-c5ec32fedd9e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:44.547886 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ea8d6edf-8dd8-498a-847f-c5ec32fedd9e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:44.548390 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ea8d6edf-8dd8-498a-847f-c5ec32fedd9e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:44.549148 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ea8d6edf-8dd8-498a-847f-c5ec32fedd9e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:44.549666 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ea8d6edf-8dd8-498a-847f-c5ec32fedd9e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:44.550167 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ea8d6edf-8dd8-498a-847f-c5ec32fedd9e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:44.750593 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-ea8d6edf-8dd8-498a-847f-c5ec32fedd9e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:44:44.760657 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-ea8d6edf-8dd8-498a-847f-c5ec32fedd9e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31" status: 200 len: 1680 microversion: 2.1 time: 0.232870 Aug 24 07:44:44.761237 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 269/549] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:44:44 2022] GET /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31 => generated 1680 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:44.963163 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-79cf64ee-fbf7-4f2c-bc48-df42f224d264 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Action: 'create', calling method: .version_select at 0x7faf6856f040>, body: {"keypair": {"name": "tempest-TestShelveInstance-180187044", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKv53GQ8Z56CEgrflKB+TgcagM6UKoc9wUaMwcE6EAlvFUnlp5MZIADCwvoKf6BNoUUdPALY2oiMxMMCke3oPRmVBTtyKgFZwXc7YpVS1QVcfPv6c4slCdNpdP/35aHOA=="}} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:44:44.983943 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.quota [None req-79cf64ee-fbf7-4f2c-bc48-df42f224d264 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Getting quotas for project c75359bcb24b4beb8de99809d2bef6fa. Resources: {'key_pairs'} {{(pid=127114) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:44:44.989694 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.quota [None req-79cf64ee-fbf7-4f2c-bc48-df42f224d264 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Getting quotas for user 75bdaeec19be45388613c7e22aa009db and project c75359bcb24b4beb8de99809d2bef6fa. Resources: {'key_pairs'} {{(pid=127114) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:44:45.024235 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-79cf64ee-fbf7-4f2c-bc48-df42f224d264 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.333035 Aug 24 07:44:45.026638 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 281/550] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Aug 24 07:44:44 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:44:45.228261 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-53069f89-c37f-43ce-ac80-5e208a69885f tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Action: 'create', calling method: .version_select at 0x7faf5bd9b670>, body: {"keypair": {"name": "tempest-keypair-526182087", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJI71NIupkUmmRc/I8Phn82E8MYF7VRAoWEYUEs3aZVntGPnG5yQN4Acsoo0teGy+uTces0aCF9C2DY+EZVtjCBf4wW0UPOYFjmk9N4lTs+tPjbbcF6FmKQEiWdLx/VNZg=="}} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:44:45.245462 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.quota [None req-53069f89-c37f-43ce-ac80-5e208a69885f tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Getting quotas for project 3e9b29dbfd404c008fe871808d41e059. Resources: {'key_pairs'} {{(pid=127113) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:44:45.249371 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.quota [None req-53069f89-c37f-43ce-ac80-5e208a69885f tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Getting quotas for user 072548785a38488db94ee05dfbf8c8ec and project 3e9b29dbfd404c008fe871808d41e059. Resources: {'key_pairs'} {{(pid=127113) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:44:45.277730 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-53069f89-c37f-43ce-ac80-5e208a69885f tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.063882 Aug 24 07:44:45.278950 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 270/551] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Aug 24 07:44:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:44:45.800979 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-2a6a4b4a-931d-4e50-9715-b294b00d0fdd tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:45.802095 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-2a6a4b4a-931d-4e50-9715-b294b00d0fdd tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: 851572e6-8dda-401b-aab8-58fbe54a2b31] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:45.824022 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2a6a4b4a-931d-4e50-9715-b294b00d0fdd tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:45.826447 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2a6a4b4a-931d-4e50-9715-b294b00d0fdd tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:45.827224 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2a6a4b4a-931d-4e50-9715-b294b00d0fdd tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:45.828404 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2a6a4b4a-931d-4e50-9715-b294b00d0fdd tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:45.829623 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2a6a4b4a-931d-4e50-9715-b294b00d0fdd tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:45.830488 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2a6a4b4a-931d-4e50-9715-b294b00d0fdd tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:45.838434 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:45.932327 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-2a6a4b4a-931d-4e50-9715-b294b00d0fdd tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:44:45.943036 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-2a6a4b4a-931d-4e50-9715-b294b00d0fdd tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31" status: 200 len: 1613 microversion: 2.1 time: 0.161172 Aug 24 07:44:45.944001 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 282/552] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:44:45 2022] GET /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31 => generated 1613 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:46.174485 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [req-3918d34a-00b6-4ffa-883e-ab4c07fa0928 req-4dff580e-6195-44f2-82fe-3ef5f99b6371 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "851572e6-8dda-401b-aab8-58fbe54a2b31", "name": "network-vif-deleted", "tag": "7aba0a71-3684-421c-8bb6-d7a57f843f6f"}]} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:44:46.190403 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-3918d34a-00b6-4ffa-883e-ab4c07fa0928 req-4dff580e-6195-44f2-82fe-3ef5f99b6371 service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:46.193033 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-3918d34a-00b6-4ffa-883e-ab4c07fa0928 req-4dff580e-6195-44f2-82fe-3ef5f99b6371 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:46.193819 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-3918d34a-00b6-4ffa-883e-ab4c07fa0928 req-4dff580e-6195-44f2-82fe-3ef5f99b6371 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:46.206734 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.compute.server_external_events [req-3918d34a-00b6-4ffa-883e-ab4c07fa0928 req-4dff580e-6195-44f2-82fe-3ef5f99b6371 service nova] Creating event network-vif-deleted:7aba0a71-3684-421c-8bb6-d7a57f843f6f for instance 851572e6-8dda-401b-aab8-58fbe54a2b31 on hv-cinder-85427 Aug 24 07:44:46.214372 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [req-3918d34a-00b6-4ffa-883e-ab4c07fa0928 req-4dff580e-6195-44f2-82fe-3ef5f99b6371 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043373 Aug 24 07:44:46.215360 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 271/553] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:44:46.965595 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-0e3d2434-728a-4e3b-a3d6-ee7f237542e0 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:46.967609 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-0e3d2434-728a-4e3b-a3d6-ee7f237542e0 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: 851572e6-8dda-401b-aab8-58fbe54a2b31] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:46.974751 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0e3d2434-728a-4e3b-a3d6-ee7f237542e0 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:46.975578 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0e3d2434-728a-4e3b-a3d6-ee7f237542e0 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:46.976246 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0e3d2434-728a-4e3b-a3d6-ee7f237542e0 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:46.977177 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0e3d2434-728a-4e3b-a3d6-ee7f237542e0 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:46.977835 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0e3d2434-728a-4e3b-a3d6-ee7f237542e0 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:46.978475 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0e3d2434-728a-4e3b-a3d6-ee7f237542e0 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:46.998121 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.wsgi [None req-0e3d2434-728a-4e3b-a3d6-ee7f237542e0 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] HTTP exception thrown: Instance 851572e6-8dda-401b-aab8-58fbe54a2b31 could not be found. Aug 24 07:44:46.999972 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-0e3d2434-728a-4e3b-a3d6-ee7f237542e0 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Request method failure captured: Aug 24 07:44:46.999972 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: request: GET /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31 HTTP/1.1 Aug 24 07:44:46.999972 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept: application/json Aug 24 07:44:46.999972 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept-Encoding: identity Aug 24 07:44:46.999972 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Connection: close Aug 24 07:44:46.999972 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Length: 0 Aug 24 07:44:46.999972 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Type: application/json Aug 24 07:44:46.999972 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Host: 10.222.0.42 Aug 24 07:44:46.999972 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Openstack-System-Scope: None Aug 24 07:44:46.999972 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: User-Agent: python-urllib3/1.26.11 Aug 24 07:44:46.999972 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Auth-Token: gAAAAABjBdYobzFKkpFZErKGYQQ6C-XEh7i9OW8ojTbqxPVr74lckpRiFaze-efBQslsaQSX_M9uiYyghTqG7Fg_jrM-qOMOyzErIrVcNm0xIs9NgJg7VzKqJCSA-yXxsyHfCdfoLwTQ2cusI7TmXO58zoZh7YF2Ykkf3m7e8LiRBBQiO6NdfF4 Aug 24 07:44:46.999972 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Id: None Aug 24 07:44:46.999972 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Name: None Aug 24 07:44:46.999972 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Identity-Status: Confirmed Aug 24 07:44:46.999972 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Is-Admin-Project: True Aug 24 07:44:46.999972 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Id: default Aug 24 07:44:46.999972 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Name: Default Aug 24 07:44:46.999972 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Id: af5acb73124c485aa87e60b4e5d4f6d4 Aug 24 07:44:46.999972 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Name: tempest-AttachVolumeNegativeTest-1077633228 Aug 24 07:44:46.999972 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Role: reader,member Aug 24 07:44:46.999972 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Roles: reader,member Aug 24 07:44:47.001199 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af5acb73124c485aa87e60b4e5d4f6d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_af5acb73124c485aa87e60b4e5d4f6d4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af5acb73124c485aa87e60b4e5d4f6d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/af5acb73124c485aa87e60b4e5d4f6d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:44:47.001199 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant: tempest-AttachVolumeNegativeTest-1077633228 Aug 24 07:44:47.001199 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Id: af5acb73124c485aa87e60b4e5d4f6d4 Aug 24 07:44:47.001199 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1077633228 Aug 24 07:44:47.001199 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User: tempest-AttachVolumeNegativeTest-1077633228-project Aug 24 07:44:47.001199 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Id: default Aug 24 07:44:47.001199 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Name: Default Aug 24 07:44:47.001199 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Id: f594c9344b2c472ba33ceef87ec88a0b Aug 24 07:44:47.001199 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Name: tempest-AttachVolumeNegativeTest-1077633228-project Aug 24 07:44:47.001199 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: method: > Aug 24 07:44:47.001199 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: exception: Instance 851572e6-8dda-401b-aab8-58fbe54a2b31 could not be found. Aug 24 07:44:47.001199 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: action_args: {'id': '851572e6-8dda-401b-aab8-58fbe54a2b31'} Aug 24 07:44:47.001891 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:44:47.001891 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:44:47.001891 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:44:47.001891 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:44:47.001891 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:44:47.001891 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:44:47.001891 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:44:47.001891 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:44:47.001891 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:44:47.001891 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:44:47.001891 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 851572e6-8dda-401b-aab8-58fbe54a2b31 could not be found. Aug 24 07:44:47.001891 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:44:47.001891 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:44:47.001891 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:44:47.001891 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:44:47.001891 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:44:47.001891 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:44:47.001891 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:44:47.001891 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:44:47.001891 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:44:47.003021 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:44:47.003021 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 07:44:47.003021 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 07:44:47.003021 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:44:47.003021 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:44:47.003021 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:44:47.003021 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:44:47.003021 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 851572e6-8dda-401b-aab8-58fbe54a2b31 could not be found. Aug 24 07:44:47.003021 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:44:47.003021 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:44:47.003021 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:44:47.003021 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:44:47.003021 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:44:47.003021 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:44:47.003021 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:44:47.003021 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:44:47.003021 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 851572e6-8dda-401b-aab8-58fbe54a2b31 could not be found. Aug 24 07:44:47.003021 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:44:47.005512 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-0e3d2434-728a-4e3b-a3d6-ee7f237542e0 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Returning 404 to user: Instance 851572e6-8dda-401b-aab8-58fbe54a2b31 could not be found. {{(pid=127114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:44:47.006585 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-0e3d2434-728a-4e3b-a3d6-ee7f237542e0 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31" status: 404 len: 111 microversion: 2.1 time: 0.046057 Aug 24 07:44:47.007705 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 283/554] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:44:46 2022] GET /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:44:47.018198 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-66d29286-6406-48ae-b193-8e87f0c66197 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '.version_select at 0x7faf5bcdc3a0>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:47.061140 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-66d29286-6406-48ae-b193-8e87f0c66197 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-444654930" status: 202 len: 0 microversion: 2.1 time: 0.047952 Aug 24 07:44:47.062040 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 272/555] 10.222.0.42 () {58 vars in 1218 bytes} [Wed Aug 24 07:44:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-444654930 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 07:44:47.595896 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-cd1c201a-664f-449d-adef-c1c43812c031 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-212599664", "imageRef": "4358f547-a499-43f3-9c84-925d78cd73db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5fad6b53-b767-43a2-a080-e8a313d40535"}], "security_groups": [{"name": "tempest-securitygroup--2105799858"}], "key_name": "tempest-keypair-526182087", "user_data": "}} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:44:47.792650 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.network.neutron [None req-cd1c201a-664f-449d-adef-c1c43812c031 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] validate_networks() for [('5fad6b53-b767-43a2-a080-e8a313d40535', None, None, None, None, None)] {{(pid=127114) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 07:44:48.041199 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-3be3d513-210c-4222-80a8-a7667e97b8da tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:48.041789 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-3be3d513-210c-4222-80a8-a7667e97b8da tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: d596e142-eb18-49d4-8eb8-bec422282059] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:48.048682 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3be3d513-210c-4222-80a8-a7667e97b8da tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:48.049163 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3be3d513-210c-4222-80a8-a7667e97b8da tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:48.049602 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3be3d513-210c-4222-80a8-a7667e97b8da tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:48.050834 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3be3d513-210c-4222-80a8-a7667e97b8da tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:48.051540 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3be3d513-210c-4222-80a8-a7667e97b8da tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:48.051970 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3be3d513-210c-4222-80a8-a7667e97b8da tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:48.150928 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.objects.instance [None req-3be3d513-210c-4222-80a8-a7667e97b8da tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lazy-loading 'services' on Instance uuid d596e142-eb18-49d4-8eb8-bec422282059 {{(pid=127113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:44:48.245158 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-3be3d513-210c-4222-80a8-a7667e97b8da tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d596e142-eb18-49d4-8eb8-bec422282059/os-volume_attachments/7a4fcf7f-d359-41bd-a444-1c1efc4cd791" status: 202 len: 0 microversion: 2.1 time: 0.207525 Aug 24 07:44:48.246114 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 273/556] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Aug 24 07:44:48 2022] DELETE /compute/v2.1/servers/d596e142-eb18-49d4-8eb8-bec422282059/os-volume_attachments/7a4fcf7f-d359-41bd-a444-1c1efc4cd791 => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 07:44:48.257917 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-c8fc9961-e82a-4fbb-a4bd-39f001d790ed tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:48.260776 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-c8fc9961-e82a-4fbb-a4bd-39f001d790ed tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: d596e142-eb18-49d4-8eb8-bec422282059] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:48.267369 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c8fc9961-e82a-4fbb-a4bd-39f001d790ed tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:48.268085 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c8fc9961-e82a-4fbb-a4bd-39f001d790ed tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:48.268700 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c8fc9961-e82a-4fbb-a4bd-39f001d790ed tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:48.269451 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c8fc9961-e82a-4fbb-a4bd-39f001d790ed tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:48.269889 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c8fc9961-e82a-4fbb-a4bd-39f001d790ed tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:48.270308 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c8fc9961-e82a-4fbb-a4bd-39f001d790ed tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:48.303751 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-c8fc9961-e82a-4fbb-a4bd-39f001d790ed tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/d596e142-eb18-49d4-8eb8-bec422282059/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052946 Aug 24 07:44:48.304317 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 274/557] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 24 07:44:48 2022] GET /compute/v2.1/servers/d596e142-eb18-49d4-8eb8-bec422282059/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:44:48.345458 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-cd1c201a-664f-449d-adef-c1c43812c031 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Flavor limits 0:0:0 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 07:44:48.346043 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-cd1c201a-664f-449d-adef-c1c43812c031 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Image limits 0:0:0 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 07:44:48.346334 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-cd1c201a-664f-449d-adef-c1c43812c031 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Flavor pref 0:0:0 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 07:44:48.346763 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-cd1c201a-664f-449d-adef-c1c43812c031 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Image pref 0:0:0 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 07:44:48.347357 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-cd1c201a-664f-449d-adef-c1c43812c031 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 07:44:48.356259 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cd1c201a-664f-449d-adef-c1c43812c031 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:48.356746 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cd1c201a-664f-449d-adef-c1c43812c031 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:48.357199 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cd1c201a-664f-449d-adef-c1c43812c031 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:48.358022 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cd1c201a-664f-449d-adef-c1c43812c031 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:48.358470 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cd1c201a-664f-449d-adef-c1c43812c031 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:48.359147 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cd1c201a-664f-449d-adef-c1c43812c031 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:48.376721 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.quota [None req-cd1c201a-664f-449d-adef-c1c43812c031 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Getting quotas for project 3e9b29dbfd404c008fe871808d41e059. Resources: {'cores', 'ram', 'instances'} {{(pid=127114) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:44:48.381200 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.quota [None req-cd1c201a-664f-449d-adef-c1c43812c031 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Getting quotas for user 072548785a38488db94ee05dfbf8c8ec and project 3e9b29dbfd404c008fe871808d41e059. Resources: {'cores', 'ram', 'instances'} {{(pid=127114) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:44:48.392375 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-cd1c201a-664f-449d-adef-c1c43812c031 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Going to run 1 instances... {{(pid=127114) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 07:44:48.394782 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-cd1c201a-664f-449d-adef-c1c43812c031 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 13cb624d-3028-4eaf-b4df-2983595448a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4358f547-a499-43f3-9c84-925d78cd73db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127114) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 07:44:48.449644 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-cd1c201a-664f-449d-adef-c1c43812c031 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.858725 Aug 24 07:44:48.450188 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 284/558] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 24 07:44:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 07:44:48.461087 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-cbfa770a-e162-4012-8b45-a1854f576e6e tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:48.461691 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-cbfa770a-e162-4012-8b45-a1854f576e6e tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 13cb624d-3028-4eaf-b4df-2983595448a0] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:48.517810 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-cbfa770a-e162-4012-8b45-a1854f576e6e tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:44:48.524633 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-cbfa770a-e162-4012-8b45-a1854f576e6e tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0" status: 200 len: 1236 microversion: 2.1 time: 0.067337 Aug 24 07:44:48.525267 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 275/559] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:44:48 2022] GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0 => generated 1236 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:49.317138 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-eba3261f-61ce-48fc-aed7-32c33714b18e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:49.319692 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-eba3261f-61ce-48fc-aed7-32c33714b18e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: d596e142-eb18-49d4-8eb8-bec422282059] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:49.327018 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-eba3261f-61ce-48fc-aed7-32c33714b18e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:49.327596 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-eba3261f-61ce-48fc-aed7-32c33714b18e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:49.328091 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-eba3261f-61ce-48fc-aed7-32c33714b18e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:49.328840 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-eba3261f-61ce-48fc-aed7-32c33714b18e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:49.329355 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-eba3261f-61ce-48fc-aed7-32c33714b18e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:49.329841 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-eba3261f-61ce-48fc-aed7-32c33714b18e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:49.380171 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-eba3261f-61ce-48fc-aed7-32c33714b18e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/d596e142-eb18-49d4-8eb8-bec422282059/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.068105 Aug 24 07:44:49.382570 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 285/560] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 24 07:44:49 2022] GET /compute/v2.1/servers/d596e142-eb18-49d4-8eb8-bec422282059/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 07:44:49.459925 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-6499cc00-ca21-45b8-b21c-f4acd36c87c7 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:49.460495 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-6499cc00-ca21-45b8-b21c-f4acd36c87c7 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: d596e142-eb18-49d4-8eb8-bec422282059] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:49.468062 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6499cc00-ca21-45b8-b21c-f4acd36c87c7 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:49.468478 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6499cc00-ca21-45b8-b21c-f4acd36c87c7 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:49.469274 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6499cc00-ca21-45b8-b21c-f4acd36c87c7 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:49.469901 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6499cc00-ca21-45b8-b21c-f4acd36c87c7 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:49.470597 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6499cc00-ca21-45b8-b21c-f4acd36c87c7 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:49.471076 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6499cc00-ca21-45b8-b21c-f4acd36c87c7 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:49.476228 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:49.504657 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-6499cc00-ca21-45b8-b21c-f4acd36c87c7 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: d596e142-eb18-49d4-8eb8-bec422282059] Going to try to terminate instance {{(pid=127113) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 07:44:49.548492 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-d536c618-b7a8-40b3-9f58-b0a953c83cae tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:49.551854 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-d536c618-b7a8-40b3-9f58-b0a953c83cae tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 13cb624d-3028-4eaf-b4df-2983595448a0] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:49.560133 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d536c618-b7a8-40b3-9f58-b0a953c83cae tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:49.561824 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d536c618-b7a8-40b3-9f58-b0a953c83cae tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:49.562423 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d536c618-b7a8-40b3-9f58-b0a953c83cae tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:49.563431 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d536c618-b7a8-40b3-9f58-b0a953c83cae tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:49.564113 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d536c618-b7a8-40b3-9f58-b0a953c83cae tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:49.564938 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d536c618-b7a8-40b3-9f58-b0a953c83cae tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:49.653475 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-6499cc00-ca21-45b8-b21c-f4acd36c87c7 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d596e142-eb18-49d4-8eb8-bec422282059" status: 204 len: 0 microversion: 2.1 time: 0.198527 Aug 24 07:44:49.658444 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 276/561] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 24 07:44:49 2022] DELETE /compute/v2.1/servers/d596e142-eb18-49d4-8eb8-bec422282059 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 07:44:49.664645 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-1468dd82-ddfd-4d69-9695-af836bc48d1c tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:49.665568 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-1468dd82-ddfd-4d69-9695-af836bc48d1c tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: d596e142-eb18-49d4-8eb8-bec422282059] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:49.672855 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1468dd82-ddfd-4d69-9695-af836bc48d1c tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:49.673565 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1468dd82-ddfd-4d69-9695-af836bc48d1c tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:49.674147 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1468dd82-ddfd-4d69-9695-af836bc48d1c tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:49.675693 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1468dd82-ddfd-4d69-9695-af836bc48d1c tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:49.676570 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1468dd82-ddfd-4d69-9695-af836bc48d1c tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:49.677527 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1468dd82-ddfd-4d69-9695-af836bc48d1c tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:49.709685 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-d536c618-b7a8-40b3-9f58-b0a953c83cae tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:44:49.722800 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-d536c618-b7a8-40b3-9f58-b0a953c83cae tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0" status: 200 len: 1296 microversion: 2.1 time: 0.178915 Aug 24 07:44:49.723682 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 286/562] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:44:49 2022] GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0 => generated 1296 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:49.835771 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-1468dd82-ddfd-4d69-9695-af836bc48d1c tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:44:49.843944 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-1468dd82-ddfd-4d69-9695-af836bc48d1c tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/d596e142-eb18-49d4-8eb8-bec422282059" status: 200 len: 1681 microversion: 2.1 time: 0.183614 Aug 24 07:44:49.844499 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 277/563] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:44:49 2022] GET /compute/v2.1/servers/d596e142-eb18-49d4-8eb8-bec422282059 => generated 1681 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:44:50.746121 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-1afa4287-7ffb-4d55-b248-80086cb94e46 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:50.746756 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-1afa4287-7ffb-4d55-b248-80086cb94e46 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 13cb624d-3028-4eaf-b4df-2983595448a0] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:50.754303 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1afa4287-7ffb-4d55-b248-80086cb94e46 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:50.754812 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1afa4287-7ffb-4d55-b248-80086cb94e46 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:50.755247 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1afa4287-7ffb-4d55-b248-80086cb94e46 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:50.756029 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1afa4287-7ffb-4d55-b248-80086cb94e46 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:50.756485 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1afa4287-7ffb-4d55-b248-80086cb94e46 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:50.756907 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1afa4287-7ffb-4d55-b248-80086cb94e46 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:50.826134 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-1afa4287-7ffb-4d55-b248-80086cb94e46 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:44:50.835414 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-1afa4287-7ffb-4d55-b248-80086cb94e46 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0" status: 200 len: 1294 microversion: 2.1 time: 0.093264 Aug 24 07:44:50.836000 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 287/564] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:44:50 2022] GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0 => generated 1294 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:50.865544 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-934e8005-f769-4096-b599-2aa3f37acaa3 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:50.867057 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-934e8005-f769-4096-b599-2aa3f37acaa3 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: d596e142-eb18-49d4-8eb8-bec422282059] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:50.875117 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-934e8005-f769-4096-b599-2aa3f37acaa3 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:50.875717 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-934e8005-f769-4096-b599-2aa3f37acaa3 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:50.876286 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-934e8005-f769-4096-b599-2aa3f37acaa3 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:50.877412 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-934e8005-f769-4096-b599-2aa3f37acaa3 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:50.877869 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-934e8005-f769-4096-b599-2aa3f37acaa3 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:50.878873 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-934e8005-f769-4096-b599-2aa3f37acaa3 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:51.049376 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-934e8005-f769-4096-b599-2aa3f37acaa3 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:44:51.063886 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-934e8005-f769-4096-b599-2aa3f37acaa3 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/d596e142-eb18-49d4-8eb8-bec422282059" status: 200 len: 1681 microversion: 2.1 time: 0.202220 Aug 24 07:44:51.064468 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 278/565] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:44:50 2022] GET /compute/v2.1/servers/d596e142-eb18-49d4-8eb8-bec422282059 => generated 1681 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:51.856202 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-2f77284a-14c9-4b33-b0bd-ae5ef09e32a0 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:51.856977 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-2f77284a-14c9-4b33-b0bd-ae5ef09e32a0 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 13cb624d-3028-4eaf-b4df-2983595448a0] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:51.867613 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2f77284a-14c9-4b33-b0bd-ae5ef09e32a0 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:51.870394 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2f77284a-14c9-4b33-b0bd-ae5ef09e32a0 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:51.871584 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2f77284a-14c9-4b33-b0bd-ae5ef09e32a0 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:51.872687 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2f77284a-14c9-4b33-b0bd-ae5ef09e32a0 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:51.873454 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2f77284a-14c9-4b33-b0bd-ae5ef09e32a0 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:51.874116 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2f77284a-14c9-4b33-b0bd-ae5ef09e32a0 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:52.098068 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-7f2019c3-7b1f-46d8-9208-d56d7154ea36 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:52.100083 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-7f2019c3-7b1f-46d8-9208-d56d7154ea36 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: d596e142-eb18-49d4-8eb8-bec422282059] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:52.112179 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7f2019c3-7b1f-46d8-9208-d56d7154ea36 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:52.113045 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7f2019c3-7b1f-46d8-9208-d56d7154ea36 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:52.115128 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7f2019c3-7b1f-46d8-9208-d56d7154ea36 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:52.116023 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7f2019c3-7b1f-46d8-9208-d56d7154ea36 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:52.116842 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7f2019c3-7b1f-46d8-9208-d56d7154ea36 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:52.117570 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7f2019c3-7b1f-46d8-9208-d56d7154ea36 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:52.216647 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-7f2019c3-7b1f-46d8-9208-d56d7154ea36 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:44:52.226814 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-7f2019c3-7b1f-46d8-9208-d56d7154ea36 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/d596e142-eb18-49d4-8eb8-bec422282059" status: 200 len: 1613 microversion: 2.1 time: 0.143920 Aug 24 07:44:52.227567 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 279/566] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:44:52 2022] GET /compute/v2.1/servers/d596e142-eb18-49d4-8eb8-bec422282059 => generated 1613 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:52.408223 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-2f77284a-14c9-4b33-b0bd-ae5ef09e32a0 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:44:52.419875 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-2f77284a-14c9-4b33-b0bd-ae5ef09e32a0 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0" status: 200 len: 1362 microversion: 2.1 time: 0.567483 Aug 24 07:44:52.420682 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 288/567] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:44:51 2022] GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0 => generated 1362 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:52.449792 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [req-2125ee24-fc5d-4e97-977f-3accbe7e2c15 req-4fdc12ae-9d39-42ef-838e-4c43a276eea1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d596e142-eb18-49d4-8eb8-bec422282059", "name": "network-vif-deleted", "tag": "8feec3b6-e865-473e-bce9-488008443570"}]} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:44:52.471294 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-2125ee24-fc5d-4e97-977f-3accbe7e2c15 req-4fdc12ae-9d39-42ef-838e-4c43a276eea1 service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:52.472438 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-2125ee24-fc5d-4e97-977f-3accbe7e2c15 req-4fdc12ae-9d39-42ef-838e-4c43a276eea1 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:52.472897 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-2125ee24-fc5d-4e97-977f-3accbe7e2c15 req-4fdc12ae-9d39-42ef-838e-4c43a276eea1 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:52.485268 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.compute.server_external_events [req-2125ee24-fc5d-4e97-977f-3accbe7e2c15 req-4fdc12ae-9d39-42ef-838e-4c43a276eea1 service nova] Creating event network-vif-deleted:8feec3b6-e865-473e-bce9-488008443570 for instance d596e142-eb18-49d4-8eb8-bec422282059 on hv-cinder-85427 Aug 24 07:44:52.491145 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [req-2125ee24-fc5d-4e97-977f-3accbe7e2c15 req-4fdc12ae-9d39-42ef-838e-4c43a276eea1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050831 Aug 24 07:44:52.491868 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 280/568] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:44:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:44:52.698357 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [req-15476850-e6c4-41a9-a8fe-b40b1b79dbea req-cded4084-d62b-4baf-9749-931833449f6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13cb624d-3028-4eaf-b4df-2983595448a0", "tag": "c9648457-ce05-40d7-8216-6e29fae87db0"}]} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:44:52.708810 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-15476850-e6c4-41a9-a8fe-b40b1b79dbea req-cded4084-d62b-4baf-9749-931833449f6d service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:52.709368 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-15476850-e6c4-41a9-a8fe-b40b1b79dbea req-cded4084-d62b-4baf-9749-931833449f6d service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:52.709860 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-15476850-e6c4-41a9-a8fe-b40b1b79dbea req-cded4084-d62b-4baf-9749-931833449f6d service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:52.720763 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.compute.server_external_events [req-15476850-e6c4-41a9-a8fe-b40b1b79dbea req-cded4084-d62b-4baf-9749-931833449f6d service nova] Creating event network-changed:c9648457-ce05-40d7-8216-6e29fae87db0 for instance 13cb624d-3028-4eaf-b4df-2983595448a0 on hv-cinder-85427 Aug 24 07:44:52.726428 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [req-15476850-e6c4-41a9-a8fe-b40b1b79dbea req-cded4084-d62b-4baf-9749-931833449f6d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031798 Aug 24 07:44:52.727140 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 289/569] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:44:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:44:53.249550 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-d0ece5c3-29ca-4657-9007-f4434821eada tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:53.250258 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-d0ece5c3-29ca-4657-9007-f4434821eada tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: d596e142-eb18-49d4-8eb8-bec422282059] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:53.257344 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d0ece5c3-29ca-4657-9007-f4434821eada tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:53.257827 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d0ece5c3-29ca-4657-9007-f4434821eada tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:53.258264 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d0ece5c3-29ca-4657-9007-f4434821eada tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:53.259100 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d0ece5c3-29ca-4657-9007-f4434821eada tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:53.259559 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d0ece5c3-29ca-4657-9007-f4434821eada tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:53.259982 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d0ece5c3-29ca-4657-9007-f4434821eada tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:53.276835 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.wsgi [None req-d0ece5c3-29ca-4657-9007-f4434821eada tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] HTTP exception thrown: Instance d596e142-eb18-49d4-8eb8-bec422282059 could not be found. Aug 24 07:44:53.281393 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-d0ece5c3-29ca-4657-9007-f4434821eada tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Request method failure captured: Aug 24 07:44:53.281393 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: request: GET /compute/v2.1/servers/d596e142-eb18-49d4-8eb8-bec422282059 HTTP/1.1 Aug 24 07:44:53.281393 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept: application/json Aug 24 07:44:53.281393 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept-Encoding: identity Aug 24 07:44:53.281393 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Connection: close Aug 24 07:44:53.281393 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Length: 0 Aug 24 07:44:53.281393 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Type: application/json Aug 24 07:44:53.281393 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Host: 10.222.0.42 Aug 24 07:44:53.281393 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Openstack-System-Scope: None Aug 24 07:44:53.281393 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: User-Agent: python-urllib3/1.26.11 Aug 24 07:44:53.281393 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Auth-Token: gAAAAABjBdYobzFKkpFZErKGYQQ6C-XEh7i9OW8ojTbqxPVr74lckpRiFaze-efBQslsaQSX_M9uiYyghTqG7Fg_jrM-qOMOyzErIrVcNm0xIs9NgJg7VzKqJCSA-yXxsyHfCdfoLwTQ2cusI7TmXO58zoZh7YF2Ykkf3m7e8LiRBBQiO6NdfF4 Aug 24 07:44:53.281393 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Id: None Aug 24 07:44:53.281393 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Name: None Aug 24 07:44:53.281393 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Identity-Status: Confirmed Aug 24 07:44:53.281393 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Is-Admin-Project: True Aug 24 07:44:53.281393 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Id: default Aug 24 07:44:53.281393 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Name: Default Aug 24 07:44:53.281393 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Id: af5acb73124c485aa87e60b4e5d4f6d4 Aug 24 07:44:53.281393 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Name: tempest-AttachVolumeNegativeTest-1077633228 Aug 24 07:44:53.281393 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Role: reader,member Aug 24 07:44:53.281393 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Roles: reader,member Aug 24 07:44:53.282802 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af5acb73124c485aa87e60b4e5d4f6d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_af5acb73124c485aa87e60b4e5d4f6d4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af5acb73124c485aa87e60b4e5d4f6d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/af5acb73124c485aa87e60b4e5d4f6d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:44:53.282802 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant: tempest-AttachVolumeNegativeTest-1077633228 Aug 24 07:44:53.282802 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Id: af5acb73124c485aa87e60b4e5d4f6d4 Aug 24 07:44:53.282802 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1077633228 Aug 24 07:44:53.282802 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User: tempest-AttachVolumeNegativeTest-1077633228-project Aug 24 07:44:53.282802 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Id: default Aug 24 07:44:53.282802 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Name: Default Aug 24 07:44:53.282802 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Id: f594c9344b2c472ba33ceef87ec88a0b Aug 24 07:44:53.282802 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Name: tempest-AttachVolumeNegativeTest-1077633228-project Aug 24 07:44:53.282802 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: method: > Aug 24 07:44:53.282802 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: exception: Instance d596e142-eb18-49d4-8eb8-bec422282059 could not be found. Aug 24 07:44:53.282802 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: action_args: {'id': 'd596e142-eb18-49d4-8eb8-bec422282059'} Aug 24 07:44:53.283556 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:44:53.283556 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:44:53.283556 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:44:53.283556 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:44:53.283556 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:44:53.283556 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:44:53.283556 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:44:53.283556 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:44:53.283556 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:44:53.283556 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:44:53.283556 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d596e142-eb18-49d4-8eb8-bec422282059 could not be found. Aug 24 07:44:53.283556 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:44:53.283556 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:44:53.283556 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:44:53.283556 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:44:53.283556 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:44:53.283556 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:44:53.283556 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:44:53.283556 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:44:53.283556 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:44:53.284778 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:44:53.284778 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 07:44:53.284778 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 07:44:53.284778 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:44:53.284778 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:44:53.284778 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:44:53.284778 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:44:53.284778 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d596e142-eb18-49d4-8eb8-bec422282059 could not be found. Aug 24 07:44:53.284778 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:44:53.284778 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:44:53.284778 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:44:53.284778 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:44:53.284778 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:44:53.284778 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:44:53.284778 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:44:53.284778 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:44:53.284778 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d596e142-eb18-49d4-8eb8-bec422282059 could not be found. Aug 24 07:44:53.284778 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:44:53.285826 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-d0ece5c3-29ca-4657-9007-f4434821eada tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Returning 404 to user: Instance d596e142-eb18-49d4-8eb8-bec422282059 could not be found. {{(pid=127113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:44:53.285826 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-d0ece5c3-29ca-4657-9007-f4434821eada tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/d596e142-eb18-49d4-8eb8-bec422282059" status: 404 len: 111 microversion: 2.1 time: 0.038465 Aug 24 07:44:53.289318 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 281/570] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:44:53 2022] GET /compute/v2.1/servers/d596e142-eb18-49d4-8eb8-bec422282059 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:44:53.294540 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-9383b28a-49e6-4f62-90b5-c87ceec7e2c3 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '.version_select at 0x7faf685969d0>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:53.327116 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-9383b28a-49e6-4f62-90b5-c87ceec7e2c3 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1548250468" status: 202 len: 0 microversion: 2.1 time: 0.038354 Aug 24 07:44:53.332619 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 290/571] 10.222.0.42 () {58 vars in 1221 bytes} [Wed Aug 24 07:44:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1548250468 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 07:44:53.445024 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-7285b9cc-ea3c-4e66-a0c5-a59f7c48d5bd tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:53.445960 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-7285b9cc-ea3c-4e66-a0c5-a59f7c48d5bd tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 13cb624d-3028-4eaf-b4df-2983595448a0] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:53.453665 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7285b9cc-ea3c-4e66-a0c5-a59f7c48d5bd tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:53.454681 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7285b9cc-ea3c-4e66-a0c5-a59f7c48d5bd tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:53.455359 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7285b9cc-ea3c-4e66-a0c5-a59f7c48d5bd tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:53.456478 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7285b9cc-ea3c-4e66-a0c5-a59f7c48d5bd tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:53.457151 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7285b9cc-ea3c-4e66-a0c5-a59f7c48d5bd tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:53.457785 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7285b9cc-ea3c-4e66-a0c5-a59f7c48d5bd tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:53.668948 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-7285b9cc-ea3c-4e66-a0c5-a59f7c48d5bd tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:44:53.679926 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-7285b9cc-ea3c-4e66-a0c5-a59f7c48d5bd tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0" status: 200 len: 1362 microversion: 2.1 time: 0.242620 Aug 24 07:44:53.680877 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 282/572] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:44:53 2022] GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0 => generated 1362 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:54.152466 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-c0733c73-d3b8-4946-8e6e-bae71610318d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Action: 'create', calling method: .version_select at 0x7faf68516e50>, body: {"keypair": {"name": "tempest-keypair-1894608456", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPg6Wc75ARQIzgo5oFeLdd+Oth3H1/iZxoQclcBzpowZ7tcXIemcHBdH94lDbRrK7xGrMgush8e/ezHNIg6AoBZNCI8+QYsZcysIytTYqCQcY41DiIXfegePU2ynZ3NNQg=="}} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:44:54.168554 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.quota [None req-c0733c73-d3b8-4946-8e6e-bae71610318d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Getting quotas for project af5acb73124c485aa87e60b4e5d4f6d4. Resources: {'key_pairs'} {{(pid=127114) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:44:54.172296 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.quota [None req-c0733c73-d3b8-4946-8e6e-bae71610318d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Getting quotas for user f594c9344b2c472ba33ceef87ec88a0b and project af5acb73124c485aa87e60b4e5d4f6d4. Resources: {'key_pairs'} {{(pid=127114) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:44:54.194047 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-c0733c73-d3b8-4946-8e6e-bae71610318d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045253 Aug 24 07:44:54.194712 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 291/573] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Aug 24 07:44:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:44:54.701255 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-6d8e6ad1-9840-4587-8316-3cfc58094520 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:54.701850 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-6d8e6ad1-9840-4587-8316-3cfc58094520 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 13cb624d-3028-4eaf-b4df-2983595448a0] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:54.708925 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6d8e6ad1-9840-4587-8316-3cfc58094520 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:54.709396 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6d8e6ad1-9840-4587-8316-3cfc58094520 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:54.709818 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6d8e6ad1-9840-4587-8316-3cfc58094520 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:54.710497 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6d8e6ad1-9840-4587-8316-3cfc58094520 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:54.710970 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6d8e6ad1-9840-4587-8316-3cfc58094520 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:54.711389 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6d8e6ad1-9840-4587-8316-3cfc58094520 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:55.185352 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-6d8e6ad1-9840-4587-8316-3cfc58094520 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:44:55.203771 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-6d8e6ad1-9840-4587-8316-3cfc58094520 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0" status: 200 len: 1362 microversion: 2.1 time: 0.506441 Aug 24 07:44:55.204427 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 283/574] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:44:54 2022] GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0 => generated 1362 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:55.788871 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-1ce42775-51d5-454c-befa-a1d8f973bfc5 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1219230288", "imageRef": "4358f547-a499-43f3-9c84-925d78cd73db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "34afa070-0362-4f42-ac1a-67e0122ae46a"}], "security_groups": [{"name": "tempest-securitygroup--354366612"}], "key_name": "tempest-keypair-1894608456", "user_data": "}} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:44:55.889914 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.network.neutron [None req-1ce42775-51d5-454c-befa-a1d8f973bfc5 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] validate_networks() for [('34afa070-0362-4f42-ac1a-67e0122ae46a', None, None, None, None, None)] {{(pid=127114) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 07:44:56.225577 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-bb9a90d9-71b5-4584-b830-9f46bfb4de9a tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:56.226287 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-bb9a90d9-71b5-4584-b830-9f46bfb4de9a tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 13cb624d-3028-4eaf-b4df-2983595448a0] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:56.233129 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bb9a90d9-71b5-4584-b830-9f46bfb4de9a tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:56.233652 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bb9a90d9-71b5-4584-b830-9f46bfb4de9a tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:56.234177 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bb9a90d9-71b5-4584-b830-9f46bfb4de9a tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:56.235015 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bb9a90d9-71b5-4584-b830-9f46bfb4de9a tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:56.235559 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bb9a90d9-71b5-4584-b830-9f46bfb4de9a tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:56.236089 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bb9a90d9-71b5-4584-b830-9f46bfb4de9a tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:56.268703 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-1ce42775-51d5-454c-befa-a1d8f973bfc5 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Flavor limits 0:0:0 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 07:44:56.269125 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-1ce42775-51d5-454c-befa-a1d8f973bfc5 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Image limits 0:0:0 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 07:44:56.269621 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-1ce42775-51d5-454c-befa-a1d8f973bfc5 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Flavor pref 0:0:0 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 07:44:56.270029 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-1ce42775-51d5-454c-befa-a1d8f973bfc5 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Image pref 0:0:0 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 07:44:56.270443 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-1ce42775-51d5-454c-befa-a1d8f973bfc5 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 07:44:56.279593 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1ce42775-51d5-454c-befa-a1d8f973bfc5 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:56.280077 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1ce42775-51d5-454c-befa-a1d8f973bfc5 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:56.280508 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1ce42775-51d5-454c-befa-a1d8f973bfc5 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:56.281234 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1ce42775-51d5-454c-befa-a1d8f973bfc5 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:56.281682 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1ce42775-51d5-454c-befa-a1d8f973bfc5 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:56.282105 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1ce42775-51d5-454c-befa-a1d8f973bfc5 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:56.304369 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.quota [None req-1ce42775-51d5-454c-befa-a1d8f973bfc5 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Getting quotas for project af5acb73124c485aa87e60b4e5d4f6d4. Resources: {'cores', 'ram', 'instances'} {{(pid=127114) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:44:56.309078 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.quota [None req-1ce42775-51d5-454c-befa-a1d8f973bfc5 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Getting quotas for user f594c9344b2c472ba33ceef87ec88a0b and project af5acb73124c485aa87e60b4e5d4f6d4. Resources: {'cores', 'ram', 'instances'} {{(pid=127114) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:44:56.320697 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-1ce42775-51d5-454c-befa-a1d8f973bfc5 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Going to run 1 instances... {{(pid=127114) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 07:44:56.323116 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-1ce42775-51d5-454c-befa-a1d8f973bfc5 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: b0139656-99b6-4568-8fc1-61ac16df46d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4358f547-a499-43f3-9c84-925d78cd73db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127114) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 07:44:56.374147 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-1ce42775-51d5-454c-befa-a1d8f973bfc5 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.590636 Aug 24 07:44:56.378017 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 292/575] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 24 07:44:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 07:44:56.386286 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-496e982d-0fbd-4ad2-8f7c-795c4c219073 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:56.386928 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-496e982d-0fbd-4ad2-8f7c-795c4c219073 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: b0139656-99b6-4568-8fc1-61ac16df46d1] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:56.387799 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-bb9a90d9-71b5-4584-b830-9f46bfb4de9a tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:44:56.396615 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-bb9a90d9-71b5-4584-b830-9f46bfb4de9a tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0" status: 200 len: 1362 microversion: 2.1 time: 0.175765 Aug 24 07:44:56.397364 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 284/576] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:44:56 2022] GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0 => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:44:56.450880 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-496e982d-0fbd-4ad2-8f7c-795c4c219073 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:44:56.458819 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-496e982d-0fbd-4ad2-8f7c-795c4c219073 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1" status: 200 len: 1242 microversion: 2.1 time: 0.076553 Aug 24 07:44:56.459441 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 293/577] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:44:56 2022] GET /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1 => generated 1242 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:44:57.418563 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-802ba409-ec0d-40d7-9db6-43b24c6ae626 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:57.420195 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-802ba409-ec0d-40d7-9db6-43b24c6ae626 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 13cb624d-3028-4eaf-b4df-2983595448a0] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:57.434913 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-802ba409-ec0d-40d7-9db6-43b24c6ae626 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:57.435559 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-802ba409-ec0d-40d7-9db6-43b24c6ae626 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:57.436065 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-802ba409-ec0d-40d7-9db6-43b24c6ae626 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:57.438408 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-802ba409-ec0d-40d7-9db6-43b24c6ae626 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:57.439221 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-802ba409-ec0d-40d7-9db6-43b24c6ae626 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:57.441677 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-802ba409-ec0d-40d7-9db6-43b24c6ae626 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:57.480580 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-ed2ff1ed-49e5-4193-8f02-f44f8997b597 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:57.481344 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-ed2ff1ed-49e5-4193-8f02-f44f8997b597 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: b0139656-99b6-4568-8fc1-61ac16df46d1] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:57.494540 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ed2ff1ed-49e5-4193-8f02-f44f8997b597 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:57.495157 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ed2ff1ed-49e5-4193-8f02-f44f8997b597 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:57.495822 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ed2ff1ed-49e5-4193-8f02-f44f8997b597 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:57.496620 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ed2ff1ed-49e5-4193-8f02-f44f8997b597 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:57.497170 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ed2ff1ed-49e5-4193-8f02-f44f8997b597 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:57.507349 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ed2ff1ed-49e5-4193-8f02-f44f8997b597 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:57.640171 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-ed2ff1ed-49e5-4193-8f02-f44f8997b597 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:44:57.647847 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-802ba409-ec0d-40d7-9db6-43b24c6ae626 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:44:57.648805 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-ed2ff1ed-49e5-4193-8f02-f44f8997b597 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1" status: 200 len: 1312 microversion: 2.1 time: 0.172480 Aug 24 07:44:57.658734 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 294/578] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:44:57 2022] GET /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1 => generated 1312 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:57.659580 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-802ba409-ec0d-40d7-9db6-43b24c6ae626 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0" status: 200 len: 1362 microversion: 2.1 time: 0.245398 Aug 24 07:44:57.666714 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 285/579] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:44:57 2022] GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0 => generated 1362 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:58.692127 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-6cd7d433-a537-40ad-850c-798fbcb78b23 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:58.692751 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-6cd7d433-a537-40ad-850c-798fbcb78b23 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 13cb624d-3028-4eaf-b4df-2983595448a0] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:58.695213 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell0:SELECT=6 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:44:58.697555 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-f6310e72-5535-4c14-ab28-2fdcf0ef9149 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:58.698337 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-f6310e72-5535-4c14-ab28-2fdcf0ef9149 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: b0139656-99b6-4568-8fc1-61ac16df46d1] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:58.707130 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f6310e72-5535-4c14-ab28-2fdcf0ef9149 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:58.707609 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f6310e72-5535-4c14-ab28-2fdcf0ef9149 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:58.708036 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f6310e72-5535-4c14-ab28-2fdcf0ef9149 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:58.708728 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f6310e72-5535-4c14-ab28-2fdcf0ef9149 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:58.709176 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f6310e72-5535-4c14-ab28-2fdcf0ef9149 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:58.709595 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f6310e72-5535-4c14-ab28-2fdcf0ef9149 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:58.715339 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6cd7d433-a537-40ad-850c-798fbcb78b23 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:58.715820 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6cd7d433-a537-40ad-850c-798fbcb78b23 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:58.716413 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6cd7d433-a537-40ad-850c-798fbcb78b23 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:58.717138 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6cd7d433-a537-40ad-850c-798fbcb78b23 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:58.717586 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6cd7d433-a537-40ad-850c-798fbcb78b23 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:58.717997 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6cd7d433-a537-40ad-850c-798fbcb78b23 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:58.850514 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-6cd7d433-a537-40ad-850c-798fbcb78b23 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:44:58.859572 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-6cd7d433-a537-40ad-850c-798fbcb78b23 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0" status: 200 len: 1362 microversion: 2.1 time: 0.171704 Aug 24 07:44:58.860213 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 286/580] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:44:58 2022] GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0 => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:58.880601 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [req-2a296beb-198c-4333-94b5-7fce7c83b257 req-84bfcef1-98ca-4bda-a599-02efb3c22f5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0139656-99b6-4568-8fc1-61ac16df46d1", "tag": "b72da8e1-28c5-4441-874f-6a0d6314ddd5"}]} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:44:58.890510 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-2a296beb-198c-4333-94b5-7fce7c83b257 req-84bfcef1-98ca-4bda-a599-02efb3c22f5e service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:58.891018 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-2a296beb-198c-4333-94b5-7fce7c83b257 req-84bfcef1-98ca-4bda-a599-02efb3c22f5e service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:58.891438 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-2a296beb-198c-4333-94b5-7fce7c83b257 req-84bfcef1-98ca-4bda-a599-02efb3c22f5e service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:58.902162 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.compute.server_external_events [req-2a296beb-198c-4333-94b5-7fce7c83b257 req-84bfcef1-98ca-4bda-a599-02efb3c22f5e service nova] Creating event network-changed:b72da8e1-28c5-4441-874f-6a0d6314ddd5 for instance b0139656-99b6-4568-8fc1-61ac16df46d1 on hv-cinder-85427 Aug 24 07:44:58.906999 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [req-2a296beb-198c-4333-94b5-7fce7c83b257 req-84bfcef1-98ca-4bda-a599-02efb3c22f5e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031769 Aug 24 07:44:58.907742 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 287/581] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:44:58.955770 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-f6310e72-5535-4c14-ab28-2fdcf0ef9149 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:44:58.965716 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-f6310e72-5535-4c14-ab28-2fdcf0ef9149 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1" status: 200 len: 1367 microversion: 2.1 time: 0.281935 Aug 24 07:44:58.966372 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 295/582] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:44:58 2022] GET /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1 => generated 1367 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:44:59.535592 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [req-44b89de7-a37a-42f6-b2a9-f5cbec9dcaaa req-a9fdf3d1-eb80-4194-bb3b-16e7f1636ffc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13cb624d-3028-4eaf-b4df-2983595448a0", "name": "network-vif-plugged", "status": "completed", "tag": "c9648457-ce05-40d7-8216-6e29fae87db0"}]} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:44:59.545647 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-44b89de7-a37a-42f6-b2a9-f5cbec9dcaaa req-a9fdf3d1-eb80-4194-bb3b-16e7f1636ffc service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:59.546129 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-44b89de7-a37a-42f6-b2a9-f5cbec9dcaaa req-a9fdf3d1-eb80-4194-bb3b-16e7f1636ffc service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:59.546584 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-44b89de7-a37a-42f6-b2a9-f5cbec9dcaaa req-a9fdf3d1-eb80-4194-bb3b-16e7f1636ffc service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:59.558932 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.compute.server_external_events [req-44b89de7-a37a-42f6-b2a9-f5cbec9dcaaa req-a9fdf3d1-eb80-4194-bb3b-16e7f1636ffc service nova] Creating event network-vif-plugged:c9648457-ce05-40d7-8216-6e29fae87db0 for instance 13cb624d-3028-4eaf-b4df-2983595448a0 on hv-cinder-85427 Aug 24 07:44:59.564200 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [req-44b89de7-a37a-42f6-b2a9-f5cbec9dcaaa req-a9fdf3d1-eb80-4194-bb3b-16e7f1636ffc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033196 Aug 24 07:44:59.564797 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 288/583] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:44:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:44:59.881431 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-5e7b76fd-a7b9-44e2-8ee9-250c47eb44db tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:59.882036 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-5e7b76fd-a7b9-44e2-8ee9-250c47eb44db tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 13cb624d-3028-4eaf-b4df-2983595448a0] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:59.888519 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5e7b76fd-a7b9-44e2-8ee9-250c47eb44db tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:59.888991 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5e7b76fd-a7b9-44e2-8ee9-250c47eb44db tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:59.889418 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5e7b76fd-a7b9-44e2-8ee9-250c47eb44db tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:59.890091 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5e7b76fd-a7b9-44e2-8ee9-250c47eb44db tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:59.890536 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5e7b76fd-a7b9-44e2-8ee9-250c47eb44db tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:59.890983 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5e7b76fd-a7b9-44e2-8ee9-250c47eb44db tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:59.987723 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-01bc1935-bc77-4a02-abf3-ed360da12cc4 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:44:59.988440 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-01bc1935-bc77-4a02-abf3-ed360da12cc4 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: b0139656-99b6-4568-8fc1-61ac16df46d1] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:44:59.994460 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-01bc1935-bc77-4a02-abf3-ed360da12cc4 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:59.994963 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-01bc1935-bc77-4a02-abf3-ed360da12cc4 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:59.995391 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-01bc1935-bc77-4a02-abf3-ed360da12cc4 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:44:59.996074 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-01bc1935-bc77-4a02-abf3-ed360da12cc4 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:44:59.996516 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-01bc1935-bc77-4a02-abf3-ed360da12cc4 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:44:59.996929 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-01bc1935-bc77-4a02-abf3-ed360da12cc4 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:00.015297 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-5e7b76fd-a7b9-44e2-8ee9-250c47eb44db tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:00.023498 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-5e7b76fd-a7b9-44e2-8ee9-250c47eb44db tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0" status: 200 len: 1362 microversion: 2.1 time: 0.146406 Aug 24 07:45:00.024075 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 296/584] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:44:59 2022] GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:45:00.131941 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-01bc1935-bc77-4a02-abf3-ed360da12cc4 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:00.139369 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-01bc1935-bc77-4a02-abf3-ed360da12cc4 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1" status: 200 len: 1367 microversion: 2.1 time: 0.155875 Aug 24 07:45:00.139929 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 289/585] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:44:59 2022] GET /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:45:01.044114 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-8042aead-405b-4c06-a6a9-ff5b574ec7bc tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:01.044643 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-8042aead-405b-4c06-a6a9-ff5b574ec7bc tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 13cb624d-3028-4eaf-b4df-2983595448a0] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:01.051775 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8042aead-405b-4c06-a6a9-ff5b574ec7bc tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:01.052247 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8042aead-405b-4c06-a6a9-ff5b574ec7bc tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:01.052678 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8042aead-405b-4c06-a6a9-ff5b574ec7bc tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:01.053350 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8042aead-405b-4c06-a6a9-ff5b574ec7bc tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:01.053796 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8042aead-405b-4c06-a6a9-ff5b574ec7bc tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:01.054219 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8042aead-405b-4c06-a6a9-ff5b574ec7bc tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:01.159716 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-9bf15f68-5fa0-47c0-873f-1f2db53b183f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:01.160324 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-9bf15f68-5fa0-47c0-873f-1f2db53b183f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: b0139656-99b6-4568-8fc1-61ac16df46d1] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:01.166739 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9bf15f68-5fa0-47c0-873f-1f2db53b183f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:01.167230 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9bf15f68-5fa0-47c0-873f-1f2db53b183f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:01.167786 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9bf15f68-5fa0-47c0-873f-1f2db53b183f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:01.168483 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9bf15f68-5fa0-47c0-873f-1f2db53b183f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:01.168935 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9bf15f68-5fa0-47c0-873f-1f2db53b183f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:01.169348 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9bf15f68-5fa0-47c0-873f-1f2db53b183f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:01.187861 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-8042aead-405b-4c06-a6a9-ff5b574ec7bc tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:01.196418 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-8042aead-405b-4c06-a6a9-ff5b574ec7bc tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0" status: 200 len: 1362 microversion: 2.1 time: 0.156147 Aug 24 07:45:01.197094 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 297/586] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:45:01 2022] GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:45:01.298584 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-9bf15f68-5fa0-47c0-873f-1f2db53b183f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:01.307097 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-9bf15f68-5fa0-47c0-873f-1f2db53b183f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1" status: 200 len: 1367 microversion: 2.1 time: 0.151236 Aug 24 07:45:01.307660 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 290/587] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:45:01 2022] GET /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:45:02.216654 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-fb851020-76cf-4f6d-96ee-1b6083012be5 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:02.217168 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-fb851020-76cf-4f6d-96ee-1b6083012be5 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 13cb624d-3028-4eaf-b4df-2983595448a0] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:02.219591 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:DELETE=1 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:02.226136 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fb851020-76cf-4f6d-96ee-1b6083012be5 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:02.226614 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fb851020-76cf-4f6d-96ee-1b6083012be5 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:02.227108 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fb851020-76cf-4f6d-96ee-1b6083012be5 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:02.227794 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fb851020-76cf-4f6d-96ee-1b6083012be5 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:02.228243 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fb851020-76cf-4f6d-96ee-1b6083012be5 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:02.228658 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fb851020-76cf-4f6d-96ee-1b6083012be5 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:02.327068 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-29d0550c-52df-4ac4-ae4c-733ebf3beb33 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:02.327669 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-29d0550c-52df-4ac4-ae4c-733ebf3beb33 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: b0139656-99b6-4568-8fc1-61ac16df46d1] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:02.334657 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-29d0550c-52df-4ac4-ae4c-733ebf3beb33 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:02.335169 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-29d0550c-52df-4ac4-ae4c-733ebf3beb33 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:02.335599 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-29d0550c-52df-4ac4-ae4c-733ebf3beb33 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:02.336308 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-29d0550c-52df-4ac4-ae4c-733ebf3beb33 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:02.336920 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-29d0550c-52df-4ac4-ae4c-733ebf3beb33 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:02.337333 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-29d0550c-52df-4ac4-ae4c-733ebf3beb33 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:02.366992 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-fb851020-76cf-4f6d-96ee-1b6083012be5 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:02.375391 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-fb851020-76cf-4f6d-96ee-1b6083012be5 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0" status: 200 len: 1362 microversion: 2.1 time: 0.162603 Aug 24 07:45:02.375969 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 298/588] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:45:02 2022] GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:45:02.468696 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-29d0550c-52df-4ac4-ae4c-733ebf3beb33 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:02.476818 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-29d0550c-52df-4ac4-ae4c-733ebf3beb33 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1" status: 200 len: 1367 microversion: 2.1 time: 0.153597 Aug 24 07:45:02.477370 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 291/589] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:45:02 2022] GET /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:45:02.590677 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-528ad970-492a-4f5e-b4b7-0bb7e9df2a0f tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-185735219", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-180187044", "security_groups": [{"name": "tempest-secgroup-smoke-178802418"}], "networks": [{"uuid": "30875d09-4726-40d6-a9b1-9fbd44b98295"}], "block_device_mapping_v2": [{"uuid": "68dba1c8-2cca-49a1-8b67-ece70b1791e7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:45:02.700408 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.network.neutron [None req-528ad970-492a-4f5e-b4b7-0bb7e9df2a0f tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] validate_networks() for [('30875d09-4726-40d6-a9b1-9fbd44b98295', None, None, None, None, None)] {{(pid=127114) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 07:45:03.281260 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-528ad970-492a-4f5e-b4b7-0bb7e9df2a0f tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Flavor limits 0:0:0 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 07:45:03.282066 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-528ad970-492a-4f5e-b4b7-0bb7e9df2a0f tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Image limits 0:0:0 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 07:45:03.282066 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-528ad970-492a-4f5e-b4b7-0bb7e9df2a0f tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Flavor pref 0:0:0 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 07:45:03.282433 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-528ad970-492a-4f5e-b4b7-0bb7e9df2a0f tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Image pref 0:0:0 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 07:45:03.282881 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-528ad970-492a-4f5e-b4b7-0bb7e9df2a0f tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 07:45:03.291294 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-528ad970-492a-4f5e-b4b7-0bb7e9df2a0f tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:03.291768 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-528ad970-492a-4f5e-b4b7-0bb7e9df2a0f tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:03.292194 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-528ad970-492a-4f5e-b4b7-0bb7e9df2a0f tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:03.292902 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-528ad970-492a-4f5e-b4b7-0bb7e9df2a0f tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:03.293427 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-528ad970-492a-4f5e-b4b7-0bb7e9df2a0f tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:03.293843 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-528ad970-492a-4f5e-b4b7-0bb7e9df2a0f tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:03.310479 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.quota [None req-528ad970-492a-4f5e-b4b7-0bb7e9df2a0f tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Getting quotas for project c75359bcb24b4beb8de99809d2bef6fa. Resources: {'cores', 'ram', 'instances'} {{(pid=127114) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:45:03.314150 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.quota [None req-528ad970-492a-4f5e-b4b7-0bb7e9df2a0f tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Getting quotas for user 75bdaeec19be45388613c7e22aa009db and project c75359bcb24b4beb8de99809d2bef6fa. Resources: {'cores', 'ram', 'instances'} {{(pid=127114) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:45:03.369151 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-528ad970-492a-4f5e-b4b7-0bb7e9df2a0f tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Going to run 1 instances... {{(pid=127114) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 07:45:03.371185 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-528ad970-492a-4f5e-b4b7-0bb7e9df2a0f tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='68dba1c8-2cca-49a1-8b67-ece70b1791e7',volume_size=None,volume_type=None)] {{(pid=127114) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 07:45:03.396293 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-1174e1b6-2f8a-4e9e-a1b0-2543bd19c87c tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:03.397283 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-1174e1b6-2f8a-4e9e-a1b0-2543bd19c87c tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 13cb624d-3028-4eaf-b4df-2983595448a0] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:03.404221 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1174e1b6-2f8a-4e9e-a1b0-2543bd19c87c tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:03.404792 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1174e1b6-2f8a-4e9e-a1b0-2543bd19c87c tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:03.405452 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1174e1b6-2f8a-4e9e-a1b0-2543bd19c87c tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:03.406359 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1174e1b6-2f8a-4e9e-a1b0-2543bd19c87c tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:03.406853 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1174e1b6-2f8a-4e9e-a1b0-2543bd19c87c tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:03.407400 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1174e1b6-2f8a-4e9e-a1b0-2543bd19c87c tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:03.521312 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-528ad970-492a-4f5e-b4b7-0bb7e9df2a0f tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.934454 Aug 24 07:45:03.521945 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 299/590] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 24 07:45:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 936 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 07:45:03.528448 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-98ce5e07-5b60-473a-ace9-a613d3416c15 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:03.529134 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-98ce5e07-5b60-473a-ace9-a613d3416c15 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: b0139656-99b6-4568-8fc1-61ac16df46d1] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:03.538419 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-98ce5e07-5b60-473a-ace9-a613d3416c15 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:03.547250 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-98ce5e07-5b60-473a-ace9-a613d3416c15 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:03.547988 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-98ce5e07-5b60-473a-ace9-a613d3416c15 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:03.548986 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-98ce5e07-5b60-473a-ace9-a613d3416c15 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:03.549704 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-98ce5e07-5b60-473a-ace9-a613d3416c15 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:03.555009 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-98ce5e07-5b60-473a-ace9-a613d3416c15 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:03.572539 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-1174e1b6-2f8a-4e9e-a1b0-2543bd19c87c tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:03.582624 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-1174e1b6-2f8a-4e9e-a1b0-2543bd19c87c tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0" status: 200 len: 1549 microversion: 2.1 time: 0.190020 Aug 24 07:45:03.598135 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 292/591] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:45:03 2022] GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0 => generated 1549 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:45:03.603136 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-eb5958a9-4691-432b-b2a8-adeddcf7d1a8 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:03.603840 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-eb5958a9-4691-432b-b2a8-adeddcf7d1a8 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:03.663834 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-eb5958a9-4691-432b-b2a8-adeddcf7d1a8 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:03.670616 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-eb5958a9-4691-432b-b2a8-adeddcf7d1a8 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1087 microversion: 2.1 time: 0.071309 Aug 24 07:45:03.683908 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 293/592] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:45:03 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1087 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:45:03.689069 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [req-3da6dd31-7083-4d49-b3fc-e3576dcfc845 req-0bbab807-4898-4d9a-8762-1a23a815ce1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0139656-99b6-4568-8fc1-61ac16df46d1", "name": "network-vif-plugged", "status": "completed", "tag": "b72da8e1-28c5-4441-874f-6a0d6314ddd5"}]} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:45:03.693997 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:03.701422 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-3da6dd31-7083-4d49-b3fc-e3576dcfc845 req-0bbab807-4898-4d9a-8762-1a23a815ce1c service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:03.701942 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-3da6dd31-7083-4d49-b3fc-e3576dcfc845 req-0bbab807-4898-4d9a-8762-1a23a815ce1c service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:03.702391 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-3da6dd31-7083-4d49-b3fc-e3576dcfc845 req-0bbab807-4898-4d9a-8762-1a23a815ce1c service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:03.714860 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.compute.server_external_events [req-3da6dd31-7083-4d49-b3fc-e3576dcfc845 req-0bbab807-4898-4d9a-8762-1a23a815ce1c service nova] Creating event network-vif-plugged:b72da8e1-28c5-4441-874f-6a0d6314ddd5 for instance b0139656-99b6-4568-8fc1-61ac16df46d1 on hv-cinder-85427 Aug 24 07:45:03.720770 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [req-3da6dd31-7083-4d49-b3fc-e3576dcfc845 req-0bbab807-4898-4d9a-8762-1a23a815ce1c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035262 Aug 24 07:45:03.722537 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 294/593] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:45:03.728354 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-98ce5e07-5b60-473a-ace9-a613d3416c15 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:03.728526 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-b481b6d5-5dcc-4d4e-926d-c9c18c30db12 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:03.729067 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-b481b6d5-5dcc-4d4e-926d-c9c18c30db12 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 13cb624d-3028-4eaf-b4df-2983595448a0] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:03.736684 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-98ce5e07-5b60-473a-ace9-a613d3416c15 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1" status: 200 len: 1367 microversion: 2.1 time: 0.212920 Aug 24 07:45:03.738130 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b481b6d5-5dcc-4d4e-926d-c9c18c30db12 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:03.738130 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b481b6d5-5dcc-4d4e-926d-c9c18c30db12 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:03.738860 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b481b6d5-5dcc-4d4e-926d-c9c18c30db12 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:03.739543 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b481b6d5-5dcc-4d4e-926d-c9c18c30db12 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:03.739991 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b481b6d5-5dcc-4d4e-926d-c9c18c30db12 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:03.740408 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b481b6d5-5dcc-4d4e-926d-c9c18c30db12 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:03.750376 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 300/594] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:45:03 2022] GET /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1 => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:45:03.759805 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:03.834664 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-b481b6d5-5dcc-4d4e-926d-c9c18c30db12 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.110041 Aug 24 07:45:03.835471 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 295/595] 10.222.0.42 () {58 vars in 1275 bytes} [Wed Aug 24 07:45:03 2022] GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0/os-interface => generated 285 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:45:04.691631 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-0b468f2e-add4-4dd8-a246-2b6526e174cc tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:04.692224 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-0b468f2e-add4-4dd8-a246-2b6526e174cc tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:04.698615 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0b468f2e-add4-4dd8-a246-2b6526e174cc tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:04.699146 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0b468f2e-add4-4dd8-a246-2b6526e174cc tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:04.699581 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0b468f2e-add4-4dd8-a246-2b6526e174cc tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:04.700266 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0b468f2e-add4-4dd8-a246-2b6526e174cc tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:04.700735 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0b468f2e-add4-4dd8-a246-2b6526e174cc tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:04.701138 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0b468f2e-add4-4dd8-a246-2b6526e174cc tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:04.758234 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-f26c0a5e-81f8-4044-b151-404e951a9fdc tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:04.760051 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-f26c0a5e-81f8-4044-b151-404e951a9fdc tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: b0139656-99b6-4568-8fc1-61ac16df46d1] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:04.770096 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f26c0a5e-81f8-4044-b151-404e951a9fdc tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:04.770885 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f26c0a5e-81f8-4044-b151-404e951a9fdc tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:04.772391 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f26c0a5e-81f8-4044-b151-404e951a9fdc tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:04.773657 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f26c0a5e-81f8-4044-b151-404e951a9fdc tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:04.774324 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f26c0a5e-81f8-4044-b151-404e951a9fdc tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:04.775151 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f26c0a5e-81f8-4044-b151-404e951a9fdc tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:04.885720 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-0b468f2e-add4-4dd8-a246-2b6526e174cc tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:04.904892 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-0b468f2e-add4-4dd8-a246-2b6526e174cc tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1185 microversion: 2.1 time: 0.216350 Aug 24 07:45:04.905778 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 301/596] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:45:04 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1185 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:45:04.912159 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [req-f8172a83-5039-4894-bc3b-fec5bbf590bf req-f6a449e1-0e90-4cf6-a607-613900f41395 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13cb624d-3028-4eaf-b4df-2983595448a0", "tag": "c9648457-ce05-40d7-8216-6e29fae87db0"}]} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:45:04.923677 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-f8172a83-5039-4894-bc3b-fec5bbf590bf req-f6a449e1-0e90-4cf6-a607-613900f41395 service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:04.924152 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-f8172a83-5039-4894-bc3b-fec5bbf590bf req-f6a449e1-0e90-4cf6-a607-613900f41395 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:04.924569 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-f8172a83-5039-4894-bc3b-fec5bbf590bf req-f6a449e1-0e90-4cf6-a607-613900f41395 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:04.936230 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.compute.server_external_events [req-f8172a83-5039-4894-bc3b-fec5bbf590bf req-f6a449e1-0e90-4cf6-a607-613900f41395 service nova] Creating event network-changed:c9648457-ce05-40d7-8216-6e29fae87db0 for instance 13cb624d-3028-4eaf-b4df-2983595448a0 on hv-cinder-85427 Aug 24 07:45:04.942096 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [req-f8172a83-5039-4894-bc3b-fec5bbf590bf req-f6a449e1-0e90-4cf6-a607-613900f41395 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034934 Aug 24 07:45:04.943341 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 302/597] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:45:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:45:04.975998 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-f26c0a5e-81f8-4044-b151-404e951a9fdc tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:04.983812 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-f26c0a5e-81f8-4044-b151-404e951a9fdc tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1" status: 200 len: 1367 microversion: 2.1 time: 0.229976 Aug 24 07:45:04.984404 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 296/598] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:45:04 2022] GET /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1 => generated 1367 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:45:05.927669 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-087674e3-5e60-401b-974f-f9a87fb77672 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:05.929391 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-087674e3-5e60-401b-974f-f9a87fb77672 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:05.937537 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-087674e3-5e60-401b-974f-f9a87fb77672 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:05.938337 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-087674e3-5e60-401b-974f-f9a87fb77672 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:05.939507 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-087674e3-5e60-401b-974f-f9a87fb77672 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:05.940389 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-087674e3-5e60-401b-974f-f9a87fb77672 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:05.941067 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-087674e3-5e60-401b-974f-f9a87fb77672 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:05.941765 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-087674e3-5e60-401b-974f-f9a87fb77672 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:06.005442 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-54299152-2c28-46f8-81fc-020076abc136 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:06.006397 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-54299152-2c28-46f8-81fc-020076abc136 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: b0139656-99b6-4568-8fc1-61ac16df46d1] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:06.013686 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-54299152-2c28-46f8-81fc-020076abc136 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:06.014463 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-54299152-2c28-46f8-81fc-020076abc136 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:06.015028 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-54299152-2c28-46f8-81fc-020076abc136 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:06.015854 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-54299152-2c28-46f8-81fc-020076abc136 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:06.016405 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-54299152-2c28-46f8-81fc-020076abc136 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:06.016948 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-54299152-2c28-46f8-81fc-020076abc136 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:06.039345 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-087674e3-5e60-401b-974f-f9a87fb77672 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:06.053895 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-087674e3-5e60-401b-974f-f9a87fb77672 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1203 microversion: 2.1 time: 0.132081 Aug 24 07:45:06.054457 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 303/599] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:45:05 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1203 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:45:06.215277 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-54299152-2c28-46f8-81fc-020076abc136 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:06.223688 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-54299152-2c28-46f8-81fc-020076abc136 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1" status: 200 len: 1557 microversion: 2.1 time: 0.223511 Aug 24 07:45:06.224250 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 297/600] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:45:05 2022] GET /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1 => generated 1557 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:45:06.247675 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-3abdb33d-c14e-4f6c-8384-57baf6077f1e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:06.248316 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-3abdb33d-c14e-4f6c-8384-57baf6077f1e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: b0139656-99b6-4568-8fc1-61ac16df46d1] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:06.257418 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3abdb33d-c14e-4f6c-8384-57baf6077f1e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:06.258001 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3abdb33d-c14e-4f6c-8384-57baf6077f1e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:06.259305 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3abdb33d-c14e-4f6c-8384-57baf6077f1e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:06.260087 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3abdb33d-c14e-4f6c-8384-57baf6077f1e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:06.260762 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3abdb33d-c14e-4f6c-8384-57baf6077f1e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:06.261379 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3abdb33d-c14e-4f6c-8384-57baf6077f1e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:06.343904 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-3abdb33d-c14e-4f6c-8384-57baf6077f1e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103354 Aug 24 07:45:06.344494 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 304/601] 10.222.0.42 () {58 vars in 1275 bytes} [Wed Aug 24 07:45:06 2022] GET /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:45:07.038079 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [req-ae96d5be-58e1-4ede-8724-7180b57244be req-53a38a35-d834-440e-b6a4-28e3e3fcd650 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b258660f-e099-4e37-ab2a-4049ad88a647", "tag": "70dd01d5-20d6-47f1-8ddc-7d15de6b2627"}]} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:45:07.051177 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-ae96d5be-58e1-4ede-8724-7180b57244be req-53a38a35-d834-440e-b6a4-28e3e3fcd650 service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:07.051959 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-ae96d5be-58e1-4ede-8724-7180b57244be req-53a38a35-d834-440e-b6a4-28e3e3fcd650 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:07.052378 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-ae96d5be-58e1-4ede-8724-7180b57244be req-53a38a35-d834-440e-b6a4-28e3e3fcd650 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:07.065894 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.compute.server_external_events [req-ae96d5be-58e1-4ede-8724-7180b57244be req-53a38a35-d834-440e-b6a4-28e3e3fcd650 service nova] Creating event network-changed:70dd01d5-20d6-47f1-8ddc-7d15de6b2627 for instance b258660f-e099-4e37-ab2a-4049ad88a647 on hv-cinder-85427 Aug 24 07:45:07.075965 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-4c5a8183-14d9-49a4-ba91-e12630b2ae72 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:07.077155 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-4c5a8183-14d9-49a4-ba91-e12630b2ae72 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:07.080489 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [req-ae96d5be-58e1-4ede-8724-7180b57244be req-53a38a35-d834-440e-b6a4-28e3e3fcd650 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038617 Aug 24 07:45:07.083796 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 298/602] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:45:07.085624 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4c5a8183-14d9-49a4-ba91-e12630b2ae72 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:07.086369 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4c5a8183-14d9-49a4-ba91-e12630b2ae72 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:07.086856 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4c5a8183-14d9-49a4-ba91-e12630b2ae72 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:07.087660 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4c5a8183-14d9-49a4-ba91-e12630b2ae72 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:07.088133 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4c5a8183-14d9-49a4-ba91-e12630b2ae72 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:07.088546 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4c5a8183-14d9-49a4-ba91-e12630b2ae72 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:07.264129 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-4c5a8183-14d9-49a4-ba91-e12630b2ae72 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:07.272782 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-4c5a8183-14d9-49a4-ba91-e12630b2ae72 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1258 microversion: 2.1 time: 0.201259 Aug 24 07:45:07.273283 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 305/603] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:45:07 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1258 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:45:07.406376 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [req-3e1c887a-9afc-4f15-ab14-44948ad4eecc req-2d3e7746-e657-41aa-8559-ab5b23295cd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0139656-99b6-4568-8fc1-61ac16df46d1", "tag": "b72da8e1-28c5-4441-874f-6a0d6314ddd5"}]} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:45:07.415740 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-3e1c887a-9afc-4f15-ab14-44948ad4eecc req-2d3e7746-e657-41aa-8559-ab5b23295cd3 service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:07.416227 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-3e1c887a-9afc-4f15-ab14-44948ad4eecc req-2d3e7746-e657-41aa-8559-ab5b23295cd3 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:07.416642 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-3e1c887a-9afc-4f15-ab14-44948ad4eecc req-2d3e7746-e657-41aa-8559-ab5b23295cd3 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:07.427862 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.compute.server_external_events [req-3e1c887a-9afc-4f15-ab14-44948ad4eecc req-2d3e7746-e657-41aa-8559-ab5b23295cd3 service nova] Creating event network-changed:b72da8e1-28c5-4441-874f-6a0d6314ddd5 for instance b0139656-99b6-4568-8fc1-61ac16df46d1 on hv-cinder-85427 Aug 24 07:45:07.432596 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [req-3e1c887a-9afc-4f15-ab14-44948ad4eecc req-2d3e7746-e657-41aa-8559-ab5b23295cd3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030187 Aug 24 07:45:07.433381 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 299/604] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:45:08.294098 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-107e6b10-8811-4eeb-be78-4c9ff8397ee6 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:08.294790 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-107e6b10-8811-4eeb-be78-4c9ff8397ee6 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:08.301841 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-107e6b10-8811-4eeb-be78-4c9ff8397ee6 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:08.302313 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-107e6b10-8811-4eeb-be78-4c9ff8397ee6 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:08.302759 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-107e6b10-8811-4eeb-be78-4c9ff8397ee6 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:08.303445 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-107e6b10-8811-4eeb-be78-4c9ff8397ee6 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:08.303889 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-107e6b10-8811-4eeb-be78-4c9ff8397ee6 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:08.304303 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-107e6b10-8811-4eeb-be78-4c9ff8397ee6 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:08.308365 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell1:SELECT=100 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:08.448349 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-107e6b10-8811-4eeb-be78-4c9ff8397ee6 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:08.456953 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-107e6b10-8811-4eeb-be78-4c9ff8397ee6 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1258 microversion: 2.1 time: 0.166825 Aug 24 07:45:08.458295 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 306/605] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:45:08 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1258 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:45:08.974032 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-83b1a05c-2258-499c-a74a-c783d3cf4bd1 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:08.974582 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-83b1a05c-2258-499c-a74a-c783d3cf4bd1 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:08.980568 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-83b1a05c-2258-499c-a74a-c783d3cf4bd1 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:08.981042 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-83b1a05c-2258-499c-a74a-c783d3cf4bd1 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:08.981471 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-83b1a05c-2258-499c-a74a-c783d3cf4bd1 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:08.982143 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-83b1a05c-2258-499c-a74a-c783d3cf4bd1 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:08.982587 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-83b1a05c-2258-499c-a74a-c783d3cf4bd1 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:08.983032 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-83b1a05c-2258-499c-a74a-c783d3cf4bd1 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:09.060877 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.objects.instance [None req-83b1a05c-2258-499c-a74a-c783d3cf4bd1 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lazy-loading 'services' on Instance uuid 177a69e5-5a8e-48a8-99a8-928790a6a4de {{(pid=127113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:45:09.131625 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-83b1a05c-2258-499c-a74a-c783d3cf4bd1 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "DELETE /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de/os-volume_attachments/a1155f79-0776-4541-b841-27fe5250a86b" status: 202 len: 0 microversion: 2.1 time: 0.162290 Aug 24 07:45:09.132210 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 300/606] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Aug 24 07:45:08 2022] DELETE /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de/os-volume_attachments/a1155f79-0776-4541-b841-27fe5250a86b => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 07:45:09.140740 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-8e2ffc7c-ea7b-41d9-ae88-cfa7d1f7a6cf tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:09.142921 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-8e2ffc7c-ea7b-41d9-ae88-cfa7d1f7a6cf tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:09.148945 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8e2ffc7c-ea7b-41d9-ae88-cfa7d1f7a6cf tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:09.149418 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8e2ffc7c-ea7b-41d9-ae88-cfa7d1f7a6cf tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:09.149844 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8e2ffc7c-ea7b-41d9-ae88-cfa7d1f7a6cf tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:09.150529 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8e2ffc7c-ea7b-41d9-ae88-cfa7d1f7a6cf tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:09.151006 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8e2ffc7c-ea7b-41d9-ae88-cfa7d1f7a6cf tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:09.151424 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8e2ffc7c-ea7b-41d9-ae88-cfa7d1f7a6cf tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:09.183088 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-8e2ffc7c-ea7b-41d9-ae88-cfa7d1f7a6cf tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046364 Aug 24 07:45:09.183649 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 307/607] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 24 07:45:09 2022] GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:45:09.478429 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-1b2a695e-1b30-46c6-a6c2-844bc6055f3d tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:09.479149 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-1b2a695e-1b30-46c6-a6c2-844bc6055f3d tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:09.485425 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1b2a695e-1b30-46c6-a6c2-844bc6055f3d tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:09.485921 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1b2a695e-1b30-46c6-a6c2-844bc6055f3d tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:09.486348 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1b2a695e-1b30-46c6-a6c2-844bc6055f3d tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:09.487042 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1b2a695e-1b30-46c6-a6c2-844bc6055f3d tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:09.488195 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1b2a695e-1b30-46c6-a6c2-844bc6055f3d tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:09.488608 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1b2a695e-1b30-46c6-a6c2-844bc6055f3d tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:09.621103 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-1b2a695e-1b30-46c6-a6c2-844bc6055f3d tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:09.628864 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-1b2a695e-1b30-46c6-a6c2-844bc6055f3d tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1258 microversion: 2.1 time: 0.154677 Aug 24 07:45:09.629424 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 301/608] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:45:09 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:45:10.195980 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-79819e37-dce1-45c5-af55-caeacc0a270b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:10.198158 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-79819e37-dce1-45c5-af55-caeacc0a270b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:10.204566 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-79819e37-dce1-45c5-af55-caeacc0a270b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:10.205038 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-79819e37-dce1-45c5-af55-caeacc0a270b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:10.205470 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-79819e37-dce1-45c5-af55-caeacc0a270b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:10.206818 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-79819e37-dce1-45c5-af55-caeacc0a270b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:10.207267 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-79819e37-dce1-45c5-af55-caeacc0a270b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:10.207682 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-79819e37-dce1-45c5-af55-caeacc0a270b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:10.236835 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-79819e37-dce1-45c5-af55-caeacc0a270b tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044761 Aug 24 07:45:10.237415 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 308/609] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 24 07:45:10 2022] GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 07:45:10.311331 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-8155cc52-3535-465c-bd43-2bb46ce97029 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:10.311847 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-8155cc52-3535-465c-bd43-2bb46ce97029 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:10.318596 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8155cc52-3535-465c-bd43-2bb46ce97029 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:10.319110 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8155cc52-3535-465c-bd43-2bb46ce97029 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:10.319549 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8155cc52-3535-465c-bd43-2bb46ce97029 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:10.320227 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8155cc52-3535-465c-bd43-2bb46ce97029 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:10.320674 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8155cc52-3535-465c-bd43-2bb46ce97029 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:10.321099 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8155cc52-3535-465c-bd43-2bb46ce97029 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:10.345823 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-8155cc52-3535-465c-bd43-2bb46ce97029 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Going to try to terminate instance {{(pid=127113) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 07:45:10.421099 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-8155cc52-3535-465c-bd43-2bb46ce97029 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "DELETE /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de" status: 204 len: 0 microversion: 2.1 time: 0.113185 Aug 24 07:45:10.422006 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 302/610] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 24 07:45:10 2022] DELETE /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 07:45:10.430303 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-455d4897-7f98-422a-966d-56e0aba9fdae tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:10.431087 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-455d4897-7f98-422a-966d-56e0aba9fdae tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:10.437391 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-455d4897-7f98-422a-966d-56e0aba9fdae tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:10.437864 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-455d4897-7f98-422a-966d-56e0aba9fdae tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:10.438291 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-455d4897-7f98-422a-966d-56e0aba9fdae tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:10.439026 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-455d4897-7f98-422a-966d-56e0aba9fdae tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:10.439474 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-455d4897-7f98-422a-966d-56e0aba9fdae tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:10.439893 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-455d4897-7f98-422a-966d-56e0aba9fdae tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:10.576714 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-455d4897-7f98-422a-966d-56e0aba9fdae tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:10.587042 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-455d4897-7f98-422a-966d-56e0aba9fdae tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de" status: 200 len: 1689 microversion: 2.1 time: 0.160424 Aug 24 07:45:10.587612 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 309/611] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:45:10 2022] GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:45:10.650488 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-99ed5fac-5dbc-4eb2-a308-765d90ab9c7e tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:10.651218 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-99ed5fac-5dbc-4eb2-a308-765d90ab9c7e tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:10.657108 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-99ed5fac-5dbc-4eb2-a308-765d90ab9c7e tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:10.657583 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-99ed5fac-5dbc-4eb2-a308-765d90ab9c7e tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:10.658008 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-99ed5fac-5dbc-4eb2-a308-765d90ab9c7e tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:10.658718 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-99ed5fac-5dbc-4eb2-a308-765d90ab9c7e tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:10.659152 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-99ed5fac-5dbc-4eb2-a308-765d90ab9c7e tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:10.659575 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-99ed5fac-5dbc-4eb2-a308-765d90ab9c7e tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:10.787267 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-99ed5fac-5dbc-4eb2-a308-765d90ab9c7e tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:10.794981 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-99ed5fac-5dbc-4eb2-a308-765d90ab9c7e tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1258 microversion: 2.1 time: 0.148723 Aug 24 07:45:10.795540 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 303/612] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:45:10 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1258 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:45:11.607882 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-cf61a2f4-bae5-4901-81ac-d0eb9d96e0e8 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:11.608491 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-cf61a2f4-bae5-4901-81ac-d0eb9d96e0e8 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:11.614947 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cf61a2f4-bae5-4901-81ac-d0eb9d96e0e8 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:11.615421 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cf61a2f4-bae5-4901-81ac-d0eb9d96e0e8 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:11.615851 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cf61a2f4-bae5-4901-81ac-d0eb9d96e0e8 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:11.616533 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cf61a2f4-bae5-4901-81ac-d0eb9d96e0e8 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:11.616983 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cf61a2f4-bae5-4901-81ac-d0eb9d96e0e8 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:11.617403 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cf61a2f4-bae5-4901-81ac-d0eb9d96e0e8 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:11.743420 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-cf61a2f4-bae5-4901-81ac-d0eb9d96e0e8 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:11.750928 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-cf61a2f4-bae5-4901-81ac-d0eb9d96e0e8 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de" status: 200 len: 1689 microversion: 2.1 time: 0.146959 Aug 24 07:45:11.751485 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 310/613] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:45:11 2022] GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de => generated 1689 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:45:11.816371 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-28649704-b07c-4ae1-9f86-3ef816877bf0 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:11.816979 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-28649704-b07c-4ae1-9f86-3ef816877bf0 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:11.823448 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-28649704-b07c-4ae1-9f86-3ef816877bf0 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:11.823951 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-28649704-b07c-4ae1-9f86-3ef816877bf0 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:11.824368 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-28649704-b07c-4ae1-9f86-3ef816877bf0 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:11.825054 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-28649704-b07c-4ae1-9f86-3ef816877bf0 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:11.825507 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-28649704-b07c-4ae1-9f86-3ef816877bf0 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:11.825961 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-28649704-b07c-4ae1-9f86-3ef816877bf0 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:11.961114 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-28649704-b07c-4ae1-9f86-3ef816877bf0 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:11.968622 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-28649704-b07c-4ae1-9f86-3ef816877bf0 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1258 microversion: 2.1 time: 0.156593 Aug 24 07:45:11.969176 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 304/614] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:45:11 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:45:12.771421 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-01f0631b-2a0c-4839-9c47-e089e0a87b19 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:12.772025 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-01f0631b-2a0c-4839-9c47-e089e0a87b19 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:12.778350 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-01f0631b-2a0c-4839-9c47-e089e0a87b19 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:12.778931 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-01f0631b-2a0c-4839-9c47-e089e0a87b19 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:12.779365 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-01f0631b-2a0c-4839-9c47-e089e0a87b19 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:12.780062 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-01f0631b-2a0c-4839-9c47-e089e0a87b19 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:12.780496 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-01f0631b-2a0c-4839-9c47-e089e0a87b19 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:12.780917 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-01f0631b-2a0c-4839-9c47-e089e0a87b19 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:12.909753 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-01f0631b-2a0c-4839-9c47-e089e0a87b19 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:12.917368 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-01f0631b-2a0c-4839-9c47-e089e0a87b19 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de" status: 200 len: 1689 microversion: 2.1 time: 0.149779 Aug 24 07:45:12.917931 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 311/615] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:45:12 2022] GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de => generated 1689 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:45:12.988703 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-472dc690-a9ad-4a3b-9fea-9152a4efce5a tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:12.989300 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-472dc690-a9ad-4a3b-9fea-9152a4efce5a tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:12.995582 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-472dc690-a9ad-4a3b-9fea-9152a4efce5a tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:12.996051 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-472dc690-a9ad-4a3b-9fea-9152a4efce5a tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:12.996475 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-472dc690-a9ad-4a3b-9fea-9152a4efce5a tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:12.997142 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-472dc690-a9ad-4a3b-9fea-9152a4efce5a tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:12.997583 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-472dc690-a9ad-4a3b-9fea-9152a4efce5a tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:12.997996 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-472dc690-a9ad-4a3b-9fea-9152a4efce5a tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:13.125063 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-472dc690-a9ad-4a3b-9fea-9152a4efce5a tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:13.133278 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-472dc690-a9ad-4a3b-9fea-9152a4efce5a tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1258 microversion: 2.1 time: 0.148823 Aug 24 07:45:13.133829 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 305/616] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:45:12 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1258 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:45:13.939845 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-067005c7-d11a-44ec-b74d-db628140adcb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:13.940457 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-067005c7-d11a-44ec-b74d-db628140adcb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:13.942294 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell0:SELECT=6 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:13.943065 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell0:SELECT=28 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:13.949580 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-067005c7-d11a-44ec-b74d-db628140adcb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:13.950054 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-067005c7-d11a-44ec-b74d-db628140adcb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:13.950486 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-067005c7-d11a-44ec-b74d-db628140adcb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:13.951197 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-067005c7-d11a-44ec-b74d-db628140adcb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:13.951650 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-067005c7-d11a-44ec-b74d-db628140adcb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:13.952073 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-067005c7-d11a-44ec-b74d-db628140adcb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:14.077061 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-067005c7-d11a-44ec-b74d-db628140adcb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:14.084854 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-067005c7-d11a-44ec-b74d-db628140adcb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de" status: 200 len: 1689 microversion: 2.1 time: 0.150300 Aug 24 07:45:14.085424 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 312/617] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:45:13 2022] GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de => generated 1689 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:45:14.153297 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-1a569ca9-6607-4b3f-92d4-e9fc60fd3f09 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:14.153930 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-1a569ca9-6607-4b3f-92d4-e9fc60fd3f09 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:14.155909 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell0:SELECT=2 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:14.162185 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1a569ca9-6607-4b3f-92d4-e9fc60fd3f09 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:14.162662 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1a569ca9-6607-4b3f-92d4-e9fc60fd3f09 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:14.163117 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1a569ca9-6607-4b3f-92d4-e9fc60fd3f09 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:14.163796 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1a569ca9-6607-4b3f-92d4-e9fc60fd3f09 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:14.164252 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1a569ca9-6607-4b3f-92d4-e9fc60fd3f09 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:14.164673 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1a569ca9-6607-4b3f-92d4-e9fc60fd3f09 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:14.299037 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-1a569ca9-6607-4b3f-92d4-e9fc60fd3f09 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:14.307715 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-1a569ca9-6607-4b3f-92d4-e9fc60fd3f09 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1258 microversion: 2.1 time: 0.158255 Aug 24 07:45:14.308272 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 306/618] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:45:14 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:45:15.105473 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-0a8957dc-dac1-4e13-9e80-7f8f3926a231 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:15.106122 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-0a8957dc-dac1-4e13-9e80-7f8f3926a231 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:15.113074 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0a8957dc-dac1-4e13-9e80-7f8f3926a231 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:15.113554 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0a8957dc-dac1-4e13-9e80-7f8f3926a231 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:15.113983 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0a8957dc-dac1-4e13-9e80-7f8f3926a231 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:15.114672 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0a8957dc-dac1-4e13-9e80-7f8f3926a231 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:15.115149 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0a8957dc-dac1-4e13-9e80-7f8f3926a231 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:15.115569 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0a8957dc-dac1-4e13-9e80-7f8f3926a231 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:15.177402 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-0a8957dc-dac1-4e13-9e80-7f8f3926a231 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:15.185590 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-0a8957dc-dac1-4e13-9e80-7f8f3926a231 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de" status: 200 len: 1621 microversion: 2.1 time: 0.083997 Aug 24 07:45:15.186298 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 313/619] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:45:15 2022] GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de => generated 1621 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:45:15.212648 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [req-23f202e3-9b8b-48c4-a40d-531efa21f5d0 req-67ea6e3f-e875-423e-a477-d0bde8c1f51e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "177a69e5-5a8e-48a8-99a8-928790a6a4de", "name": "network-vif-deleted", "tag": "4c3c99fa-7ec3-487c-bf8f-3f7c8ee8b4ff"}]} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:45:15.223846 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-23f202e3-9b8b-48c4-a40d-531efa21f5d0 req-67ea6e3f-e875-423e-a477-d0bde8c1f51e service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:15.224320 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-23f202e3-9b8b-48c4-a40d-531efa21f5d0 req-67ea6e3f-e875-423e-a477-d0bde8c1f51e service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:15.224747 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-23f202e3-9b8b-48c4-a40d-531efa21f5d0 req-67ea6e3f-e875-423e-a477-d0bde8c1f51e service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:15.240262 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.compute.server_external_events [req-23f202e3-9b8b-48c4-a40d-531efa21f5d0 req-67ea6e3f-e875-423e-a477-d0bde8c1f51e service nova] Creating event network-vif-deleted:4c3c99fa-7ec3-487c-bf8f-3f7c8ee8b4ff for instance 177a69e5-5a8e-48a8-99a8-928790a6a4de on hv-cinder-85427 Aug 24 07:45:15.245636 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [req-23f202e3-9b8b-48c4-a40d-531efa21f5d0 req-67ea6e3f-e875-423e-a477-d0bde8c1f51e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036749 Aug 24 07:45:15.246346 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 307/620] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:45:15.328548 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-4a4d8966-af3a-4ab7-ab4c-719160a693e3 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:15.329164 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-4a4d8966-af3a-4ab7-ab4c-719160a693e3 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:15.335190 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4a4d8966-af3a-4ab7-ab4c-719160a693e3 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:15.335879 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4a4d8966-af3a-4ab7-ab4c-719160a693e3 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:15.336614 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4a4d8966-af3a-4ab7-ab4c-719160a693e3 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:15.337352 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4a4d8966-af3a-4ab7-ab4c-719160a693e3 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:15.337878 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4a4d8966-af3a-4ab7-ab4c-719160a693e3 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:15.338401 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4a4d8966-af3a-4ab7-ab4c-719160a693e3 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:15.509101 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-4a4d8966-af3a-4ab7-ab4c-719160a693e3 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:15.517239 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-4a4d8966-af3a-4ab7-ab4c-719160a693e3 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1258 microversion: 2.1 time: 0.192567 Aug 24 07:45:15.519049 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 314/621] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:45:15 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1258 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:45:16.208012 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-322e42a0-da35-4e6a-acc5-c553888cdad0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:16.208691 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-322e42a0-da35-4e6a-acc5-c553888cdad0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 177a69e5-5a8e-48a8-99a8-928790a6a4de] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:16.215479 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-322e42a0-da35-4e6a-acc5-c553888cdad0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:16.216510 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-322e42a0-da35-4e6a-acc5-c553888cdad0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:16.216510 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-322e42a0-da35-4e6a-acc5-c553888cdad0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:16.217381 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-322e42a0-da35-4e6a-acc5-c553888cdad0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:16.217721 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-322e42a0-da35-4e6a-acc5-c553888cdad0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:16.218140 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-322e42a0-da35-4e6a-acc5-c553888cdad0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:16.233635 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.wsgi [None req-322e42a0-da35-4e6a-acc5-c553888cdad0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] HTTP exception thrown: Instance 177a69e5-5a8e-48a8-99a8-928790a6a4de could not be found. Aug 24 07:45:16.235402 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-322e42a0-da35-4e6a-acc5-c553888cdad0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Request method failure captured: Aug 24 07:45:16.235402 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: request: GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de HTTP/1.1 Aug 24 07:45:16.235402 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept: application/json Aug 24 07:45:16.235402 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept-Encoding: identity Aug 24 07:45:16.235402 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Connection: close Aug 24 07:45:16.235402 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Length: 0 Aug 24 07:45:16.235402 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Type: application/json Aug 24 07:45:16.235402 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Host: 10.222.0.42 Aug 24 07:45:16.235402 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Openstack-System-Scope: None Aug 24 07:45:16.235402 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: User-Agent: python-urllib3/1.26.11 Aug 24 07:45:16.235402 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Auth-Token: gAAAAABjBdXj3OPdwVwNOikGz1pZEgQOCeh4GEqP5ntGxH9tZbilOI8irB2hmt3_ZpPS8CXIWEa2XHNjlUSveY2TpFHTN1ywO6y85GK4OQMHI4fYrZV7Il0xWKACBF1PBAEg2tFw9XsIk_TQrLA7G9okeYuatkKWc1A69fCtYrVWLZK-735LZbU Aug 24 07:45:16.235402 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Id: None Aug 24 07:45:16.235402 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Name: None Aug 24 07:45:16.235402 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Identity-Status: Confirmed Aug 24 07:45:16.235402 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Is-Admin-Project: True Aug 24 07:45:16.235402 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Id: default Aug 24 07:45:16.235402 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Name: Default Aug 24 07:45:16.235402 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Id: d5672bdc355c4f63885138bd9c7f3497 Aug 24 07:45:16.235402 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1449296042 Aug 24 07:45:16.235402 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Role: reader,member Aug 24 07:45:16.235402 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Roles: reader,member Aug 24 07:45:16.237784 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d5672bdc355c4f63885138bd9c7f3497"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d5672bdc355c4f63885138bd9c7f3497", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d5672bdc355c4f63885138bd9c7f3497"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d5672bdc355c4f63885138bd9c7f3497"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:45:16.237784 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1449296042 Aug 24 07:45:16.237784 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Id: d5672bdc355c4f63885138bd9c7f3497 Aug 24 07:45:16.237784 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1449296042 Aug 24 07:45:16.237784 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User: tempest-ServerRescueNegativeTestJSON-1449296042-project Aug 24 07:45:16.237784 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Id: default Aug 24 07:45:16.237784 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Name: Default Aug 24 07:45:16.237784 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Id: ea609a2504e64f6f9380061080976a6e Aug 24 07:45:16.237784 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1449296042-project Aug 24 07:45:16.237784 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: method: > Aug 24 07:45:16.237784 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: exception: Instance 177a69e5-5a8e-48a8-99a8-928790a6a4de could not be found. Aug 24 07:45:16.237784 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: action_args: {'id': '177a69e5-5a8e-48a8-99a8-928790a6a4de'} Aug 24 07:45:16.241889 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:45:16.241889 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:45:16.241889 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:45:16.241889 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:45:16.241889 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:45:16.241889 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:45:16.241889 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:45:16.241889 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:45:16.241889 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:45:16.241889 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:45:16.241889 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 177a69e5-5a8e-48a8-99a8-928790a6a4de could not be found. Aug 24 07:45:16.241889 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:45:16.241889 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:45:16.241889 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:45:16.241889 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:45:16.241889 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:45:16.241889 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:45:16.241889 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:45:16.241889 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:45:16.241889 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:45:16.243554 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:45:16.243554 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 07:45:16.243554 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 07:45:16.243554 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:45:16.243554 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:45:16.243554 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:45:16.243554 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:45:16.243554 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 177a69e5-5a8e-48a8-99a8-928790a6a4de could not be found. Aug 24 07:45:16.243554 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:45:16.243554 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:45:16.243554 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:45:16.243554 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:45:16.243554 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:45:16.243554 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:45:16.243554 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:45:16.243554 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:45:16.243554 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 177a69e5-5a8e-48a8-99a8-928790a6a4de could not be found. Aug 24 07:45:16.243554 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:45:16.244899 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-322e42a0-da35-4e6a-acc5-c553888cdad0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Returning 404 to user: Instance 177a69e5-5a8e-48a8-99a8-928790a6a4de could not be found. {{(pid=127113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:45:16.244899 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-322e42a0-da35-4e6a-acc5-c553888cdad0 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de" status: 404 len: 111 microversion: 2.1 time: 0.034264 Aug 24 07:45:16.244899 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 308/622] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:45:16 2022] GET /compute/v2.1/servers/177a69e5-5a8e-48a8-99a8-928790a6a4de => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:45:16.246780 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-2c132152-5b4a-422c-af50-c3164390bd12 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '.version_select at 0x7faf687cc280>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:16.266404 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-2c132152-5b4a-422c-af50-c3164390bd12 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-563726760" status: 202 len: 0 microversion: 2.1 time: 0.023385 Aug 24 07:45:16.267203 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 315/623] 10.222.0.42 () {58 vars in 1218 bytes} [Wed Aug 24 07:45:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-563726760 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 07:45:16.537854 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-1e8a33bb-4e08-41ae-a0bd-760efcccc8ff tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:16.539136 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-1e8a33bb-4e08-41ae-a0bd-760efcccc8ff tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:16.545135 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1e8a33bb-4e08-41ae-a0bd-760efcccc8ff tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:16.545698 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1e8a33bb-4e08-41ae-a0bd-760efcccc8ff tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:16.546126 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1e8a33bb-4e08-41ae-a0bd-760efcccc8ff tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:16.546826 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1e8a33bb-4e08-41ae-a0bd-760efcccc8ff tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:16.547273 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1e8a33bb-4e08-41ae-a0bd-760efcccc8ff tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:16.547681 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1e8a33bb-4e08-41ae-a0bd-760efcccc8ff tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:16.779687 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-1e8a33bb-4e08-41ae-a0bd-760efcccc8ff tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:16.788090 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-1e8a33bb-4e08-41ae-a0bd-760efcccc8ff tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1258 microversion: 2.1 time: 0.254649 Aug 24 07:45:16.788636 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 309/624] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:45:16 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1258 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:45:17.630980 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [req-4130707c-0c40-44bc-b20f-acf26f70e14c req-350342a5-a6a8-435b-b1c9-6039e5796966 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b258660f-e099-4e37-ab2a-4049ad88a647", "name": "network-vif-plugged", "status": "completed", "tag": "70dd01d5-20d6-47f1-8ddc-7d15de6b2627"}]} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:45:17.644735 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-4130707c-0c40-44bc-b20f-acf26f70e14c req-350342a5-a6a8-435b-b1c9-6039e5796966 service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:17.645218 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-4130707c-0c40-44bc-b20f-acf26f70e14c req-350342a5-a6a8-435b-b1c9-6039e5796966 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:17.645648 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-4130707c-0c40-44bc-b20f-acf26f70e14c req-350342a5-a6a8-435b-b1c9-6039e5796966 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:17.656073 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.compute.server_external_events [req-4130707c-0c40-44bc-b20f-acf26f70e14c req-350342a5-a6a8-435b-b1c9-6039e5796966 service nova] Creating event network-vif-plugged:70dd01d5-20d6-47f1-8ddc-7d15de6b2627 for instance b258660f-e099-4e37-ab2a-4049ad88a647 on hv-cinder-85427 Aug 24 07:45:17.661547 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [req-4130707c-0c40-44bc-b20f-acf26f70e14c req-350342a5-a6a8-435b-b1c9-6039e5796966 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035104 Aug 24 07:45:17.663306 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 316/625] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:45:17.809300 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-bf6a15bd-9d92-402e-aee8-154e08e14e20 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:17.810623 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-bf6a15bd-9d92-402e-aee8-154e08e14e20 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:17.820949 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bf6a15bd-9d92-402e-aee8-154e08e14e20 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:17.821537 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bf6a15bd-9d92-402e-aee8-154e08e14e20 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:17.822074 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bf6a15bd-9d92-402e-aee8-154e08e14e20 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:17.823069 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bf6a15bd-9d92-402e-aee8-154e08e14e20 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:17.823626 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bf6a15bd-9d92-402e-aee8-154e08e14e20 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:17.824248 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bf6a15bd-9d92-402e-aee8-154e08e14e20 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:18.017498 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-bf6a15bd-9d92-402e-aee8-154e08e14e20 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:18.025075 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-bf6a15bd-9d92-402e-aee8-154e08e14e20 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1258 microversion: 2.1 time: 0.220006 Aug 24 07:45:18.025633 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 310/626] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:45:17 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1258 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:45:19.045911 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-d2a833a0-770f-4c46-b867-1e507351f724 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:19.046596 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-d2a833a0-770f-4c46-b867-1e507351f724 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:19.053803 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d2a833a0-770f-4c46-b867-1e507351f724 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:19.054855 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d2a833a0-770f-4c46-b867-1e507351f724 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:19.055636 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d2a833a0-770f-4c46-b867-1e507351f724 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:19.056544 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d2a833a0-770f-4c46-b867-1e507351f724 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:19.056994 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d2a833a0-770f-4c46-b867-1e507351f724 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:19.057415 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d2a833a0-770f-4c46-b867-1e507351f724 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:19.198552 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-d2a833a0-770f-4c46-b867-1e507351f724 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:19.206277 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-d2a833a0-770f-4c46-b867-1e507351f724 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1258 microversion: 2.1 time: 0.164564 Aug 24 07:45:19.206851 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 317/627] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:45:19 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1258 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:45:19.218105 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-6039179d-620b-4794-8253-c0f52f524016 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:19.218588 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-6039179d-620b-4794-8253-c0f52f524016 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:19.225588 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6039179d-620b-4794-8253-c0f52f524016 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:19.226064 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6039179d-620b-4794-8253-c0f52f524016 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:19.226497 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6039179d-620b-4794-8253-c0f52f524016 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:19.227210 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6039179d-620b-4794-8253-c0f52f524016 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:19.227664 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6039179d-620b-4794-8253-c0f52f524016 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:19.228082 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6039179d-620b-4794-8253-c0f52f524016 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:19.254371 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-6039179d-620b-4794-8253-c0f52f524016 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Going to try to terminate instance {{(pid=127113) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 07:45:19.287925 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:19.331945 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-6039179d-620b-4794-8253-c0f52f524016 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 204 len: 0 microversion: 2.1 time: 0.117317 Aug 24 07:45:19.332560 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 311/628] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 24 07:45:19 2022] DELETE /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 07:45:19.340411 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-363533bb-6e95-4fe6-9431-9de1b9c10398 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:19.341125 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-363533bb-6e95-4fe6-9431-9de1b9c10398 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:19.347799 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-363533bb-6e95-4fe6-9431-9de1b9c10398 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:19.348273 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-363533bb-6e95-4fe6-9431-9de1b9c10398 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:19.348706 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-363533bb-6e95-4fe6-9431-9de1b9c10398 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:19.349387 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-363533bb-6e95-4fe6-9431-9de1b9c10398 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:19.349839 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-363533bb-6e95-4fe6-9431-9de1b9c10398 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:19.350250 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-363533bb-6e95-4fe6-9431-9de1b9c10398 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:19.473861 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-363533bb-6e95-4fe6-9431-9de1b9c10398 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:19.481481 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-363533bb-6e95-4fe6-9431-9de1b9c10398 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 200 len: 1508 microversion: 2.1 time: 0.144963 Aug 24 07:45:19.482038 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 318/629] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:45:19 2022] GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 1508 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:45:20.227473 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-366ee35f-d099-4851-8e9d-8d650d36c49e tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:20.228163 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-366ee35f-d099-4851-8e9d-8d650d36c49e tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:20.234488 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-366ee35f-d099-4851-8e9d-8d650d36c49e tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:20.234989 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-366ee35f-d099-4851-8e9d-8d650d36c49e tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:20.235419 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-366ee35f-d099-4851-8e9d-8d650d36c49e tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:20.236092 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-366ee35f-d099-4851-8e9d-8d650d36c49e tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:20.236534 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-366ee35f-d099-4851-8e9d-8d650d36c49e tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:20.237021 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-366ee35f-d099-4851-8e9d-8d650d36c49e tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:20.371963 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-366ee35f-d099-4851-8e9d-8d650d36c49e tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:20.380239 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-366ee35f-d099-4851-8e9d-8d650d36c49e tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1441 microversion: 2.1 time: 0.156953 Aug 24 07:45:20.380797 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 312/630] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:45:20 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1441 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:45:20.399913 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-e1eef35c-e260-40c7-a23e-318003b7b395 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:20.400529 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-e1eef35c-e260-40c7-a23e-318003b7b395 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:20.406946 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e1eef35c-e260-40c7-a23e-318003b7b395 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:20.407431 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e1eef35c-e260-40c7-a23e-318003b7b395 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:20.407867 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e1eef35c-e260-40c7-a23e-318003b7b395 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:20.408558 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e1eef35c-e260-40c7-a23e-318003b7b395 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:20.409016 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e1eef35c-e260-40c7-a23e-318003b7b395 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:20.409435 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e1eef35c-e260-40c7-a23e-318003b7b395 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:20.503456 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-9505e493-af32-4579-a113-fe6fe260ca58 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:20.504208 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-9505e493-af32-4579-a113-fe6fe260ca58 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:20.509998 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9505e493-af32-4579-a113-fe6fe260ca58 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:20.510480 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9505e493-af32-4579-a113-fe6fe260ca58 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:20.511001 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9505e493-af32-4579-a113-fe6fe260ca58 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:20.511717 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9505e493-af32-4579-a113-fe6fe260ca58 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:20.512168 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9505e493-af32-4579-a113-fe6fe260ca58 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:20.512589 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9505e493-af32-4579-a113-fe6fe260ca58 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:20.536735 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-e1eef35c-e260-40c7-a23e-318003b7b395 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:20.544460 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-e1eef35c-e260-40c7-a23e-318003b7b395 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1441 microversion: 2.1 time: 0.148360 Aug 24 07:45:20.545026 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 319/631] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:45:20 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1441 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:45:20.664693 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-9505e493-af32-4579-a113-fe6fe260ca58 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:20.672299 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-9505e493-af32-4579-a113-fe6fe260ca58 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 200 len: 1508 microversion: 2.1 time: 0.173340 Aug 24 07:45:20.672865 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 313/632] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:45:20 2022] GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 1508 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:45:21.193516 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 07:45:21.193755 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Wed Aug 24 07:45:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 07:45:21.695359 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-cffb5293-f538-4a8a-96da-6aad7f0c25e4 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:21.695968 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-cffb5293-f538-4a8a-96da-6aad7f0c25e4 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:21.702888 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cffb5293-f538-4a8a-96da-6aad7f0c25e4 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:21.703374 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cffb5293-f538-4a8a-96da-6aad7f0c25e4 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:21.703897 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cffb5293-f538-4a8a-96da-6aad7f0c25e4 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:21.704596 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cffb5293-f538-4a8a-96da-6aad7f0c25e4 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:21.705047 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cffb5293-f538-4a8a-96da-6aad7f0c25e4 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:21.706053 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cffb5293-f538-4a8a-96da-6aad7f0c25e4 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:21.940491 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-cffb5293-f538-4a8a-96da-6aad7f0c25e4 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:21.948210 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-cffb5293-f538-4a8a-96da-6aad7f0c25e4 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 200 len: 1508 microversion: 2.1 time: 0.256670 Aug 24 07:45:21.948781 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 320/633] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:45:21 2022] GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 1508 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:45:22.125762 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [req-39d1d205-d716-4ed4-93ac-809095e98ee6 req-5978cac9-5f0e-417d-93e7-a7da5dcbec00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b258660f-e099-4e37-ab2a-4049ad88a647", "tag": "70dd01d5-20d6-47f1-8ddc-7d15de6b2627"}]} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:45:22.139577 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-39d1d205-d716-4ed4-93ac-809095e98ee6 req-5978cac9-5f0e-417d-93e7-a7da5dcbec00 service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:22.140499 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-39d1d205-d716-4ed4-93ac-809095e98ee6 req-5978cac9-5f0e-417d-93e7-a7da5dcbec00 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:22.140923 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-39d1d205-d716-4ed4-93ac-809095e98ee6 req-5978cac9-5f0e-417d-93e7-a7da5dcbec00 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:22.151462 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.compute.server_external_events [req-39d1d205-d716-4ed4-93ac-809095e98ee6 req-5978cac9-5f0e-417d-93e7-a7da5dcbec00 service nova] Creating event network-changed:70dd01d5-20d6-47f1-8ddc-7d15de6b2627 for instance b258660f-e099-4e37-ab2a-4049ad88a647 on hv-cinder-85427 Aug 24 07:45:22.156518 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [req-39d1d205-d716-4ed4-93ac-809095e98ee6 req-5978cac9-5f0e-417d-93e7-a7da5dcbec00 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034375 Aug 24 07:45:22.157120 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 314/634] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:45:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:45:22.968802 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-3410e4ac-e20f-435b-a178-4a4f6f3ed008 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:22.969515 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-3410e4ac-e20f-435b-a178-4a4f6f3ed008 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:22.981272 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3410e4ac-e20f-435b-a178-4a4f6f3ed008 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:22.987180 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3410e4ac-e20f-435b-a178-4a4f6f3ed008 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:22.995731 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3410e4ac-e20f-435b-a178-4a4f6f3ed008 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:22.999106 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3410e4ac-e20f-435b-a178-4a4f6f3ed008 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:23.000189 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3410e4ac-e20f-435b-a178-4a4f6f3ed008 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:23.000907 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3410e4ac-e20f-435b-a178-4a4f6f3ed008 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:23.055608 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [req-23b5cfb6-36d9-4041-a50e-99c5b89ea80f req-81ca1631-f650-495d-bfd1-d56109753709 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b4bf55c-7b42-416d-bc13-3d3fe94a7694", "name": "network-vif-deleted", "tag": "12b994e4-39af-459c-ad7b-f5e92a5abf57"}]} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:45:23.082441 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-3410e4ac-e20f-435b-a178-4a4f6f3ed008 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:23.089100 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-23b5cfb6-36d9-4041-a50e-99c5b89ea80f req-81ca1631-f650-495d-bfd1-d56109753709 service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:23.089942 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-23b5cfb6-36d9-4041-a50e-99c5b89ea80f req-81ca1631-f650-495d-bfd1-d56109753709 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:23.092036 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-23b5cfb6-36d9-4041-a50e-99c5b89ea80f req-81ca1631-f650-495d-bfd1-d56109753709 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:23.102816 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-3410e4ac-e20f-435b-a178-4a4f6f3ed008 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 200 len: 1466 microversion: 2.1 time: 0.137584 Aug 24 07:45:23.104815 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 321/635] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:45:22 2022] GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 1466 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:45:23.126456 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.compute.server_external_events [req-23b5cfb6-36d9-4041-a50e-99c5b89ea80f req-81ca1631-f650-495d-bfd1-d56109753709 service nova] Creating event network-vif-deleted:12b994e4-39af-459c-ad7b-f5e92a5abf57 for instance 2b4bf55c-7b42-416d-bc13-3d3fe94a7694 on hv-cinder-85427 Aug 24 07:45:23.133826 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [req-23b5cfb6-36d9-4041-a50e-99c5b89ea80f req-81ca1631-f650-495d-bfd1-d56109753709 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084851 Aug 24 07:45:23.135898 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 315/636] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:45:24.124003 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-c6e18914-c135-422f-918b-b0798577abf5 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:24.124601 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-c6e18914-c135-422f-918b-b0798577abf5 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2b4bf55c-7b42-416d-bc13-3d3fe94a7694] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:24.131136 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c6e18914-c135-422f-918b-b0798577abf5 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:24.131617 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c6e18914-c135-422f-918b-b0798577abf5 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:24.132047 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c6e18914-c135-422f-918b-b0798577abf5 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:24.132736 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c6e18914-c135-422f-918b-b0798577abf5 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:24.133186 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c6e18914-c135-422f-918b-b0798577abf5 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:24.133607 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c6e18914-c135-422f-918b-b0798577abf5 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:24.147023 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.wsgi [None req-c6e18914-c135-422f-918b-b0798577abf5 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] HTTP exception thrown: Instance 2b4bf55c-7b42-416d-bc13-3d3fe94a7694 could not be found. Aug 24 07:45:24.148620 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-c6e18914-c135-422f-918b-b0798577abf5 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Request method failure captured: Aug 24 07:45:24.148620 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: request: GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 HTTP/1.1 Aug 24 07:45:24.148620 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept: application/json Aug 24 07:45:24.148620 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept-Encoding: identity Aug 24 07:45:24.148620 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Connection: close Aug 24 07:45:24.148620 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Length: 0 Aug 24 07:45:24.148620 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Type: application/json Aug 24 07:45:24.148620 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Host: 10.222.0.42 Aug 24 07:45:24.148620 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Openstack-System-Scope: None Aug 24 07:45:24.148620 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: User-Agent: python-urllib3/1.26.11 Aug 24 07:45:24.148620 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Auth-Token: gAAAAABjBdXj3OPdwVwNOikGz1pZEgQOCeh4GEqP5ntGxH9tZbilOI8irB2hmt3_ZpPS8CXIWEa2XHNjlUSveY2TpFHTN1ywO6y85GK4OQMHI4fYrZV7Il0xWKACBF1PBAEg2tFw9XsIk_TQrLA7G9okeYuatkKWc1A69fCtYrVWLZK-735LZbU Aug 24 07:45:24.148620 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Id: None Aug 24 07:45:24.148620 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Name: None Aug 24 07:45:24.148620 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Identity-Status: Confirmed Aug 24 07:45:24.148620 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Is-Admin-Project: True Aug 24 07:45:24.148620 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Id: default Aug 24 07:45:24.148620 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Name: Default Aug 24 07:45:24.148620 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Id: d5672bdc355c4f63885138bd9c7f3497 Aug 24 07:45:24.148620 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1449296042 Aug 24 07:45:24.148620 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Role: reader,member Aug 24 07:45:24.148620 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Roles: reader,member Aug 24 07:45:24.150065 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d5672bdc355c4f63885138bd9c7f3497"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d5672bdc355c4f63885138bd9c7f3497", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d5672bdc355c4f63885138bd9c7f3497"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d5672bdc355c4f63885138bd9c7f3497"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:45:24.150065 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1449296042 Aug 24 07:45:24.150065 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Id: d5672bdc355c4f63885138bd9c7f3497 Aug 24 07:45:24.150065 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1449296042 Aug 24 07:45:24.150065 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User: tempest-ServerRescueNegativeTestJSON-1449296042-project Aug 24 07:45:24.150065 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Id: default Aug 24 07:45:24.150065 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Name: Default Aug 24 07:45:24.150065 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Id: ea609a2504e64f6f9380061080976a6e Aug 24 07:45:24.150065 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1449296042-project Aug 24 07:45:24.150065 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: method: > Aug 24 07:45:24.150065 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: exception: Instance 2b4bf55c-7b42-416d-bc13-3d3fe94a7694 could not be found. Aug 24 07:45:24.150065 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: action_args: {'id': '2b4bf55c-7b42-416d-bc13-3d3fe94a7694'} Aug 24 07:45:24.150916 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:45:24.150916 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:45:24.150916 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:45:24.150916 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:45:24.150916 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:45:24.150916 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:45:24.150916 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:45:24.150916 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:45:24.150916 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:45:24.150916 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:45:24.150916 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b4bf55c-7b42-416d-bc13-3d3fe94a7694 could not be found. Aug 24 07:45:24.150916 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:45:24.150916 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:45:24.150916 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:45:24.150916 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:45:24.150916 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:45:24.150916 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:45:24.150916 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:45:24.150916 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:45:24.150916 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:45:24.152306 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:45:24.152306 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 07:45:24.152306 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 07:45:24.152306 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:45:24.152306 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:45:24.152306 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:45:24.152306 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:45:24.152306 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b4bf55c-7b42-416d-bc13-3d3fe94a7694 could not be found. Aug 24 07:45:24.152306 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:45:24.152306 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:45:24.152306 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:45:24.152306 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:45:24.152306 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:45:24.152306 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:45:24.152306 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:45:24.152306 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:45:24.152306 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b4bf55c-7b42-416d-bc13-3d3fe94a7694 could not be found. Aug 24 07:45:24.152306 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:45:24.153761 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-c6e18914-c135-422f-918b-b0798577abf5 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Returning 404 to user: Instance 2b4bf55c-7b42-416d-bc13-3d3fe94a7694 could not be found. {{(pid=127114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:45:24.153761 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-c6e18914-c135-422f-918b-b0798577abf5 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694" status: 404 len: 111 microversion: 2.1 time: 0.029878 Aug 24 07:45:24.153761 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 322/637] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:45:24 2022] GET /compute/v2.1/servers/2b4bf55c-7b42-416d-bc13-3d3fe94a7694 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:45:24.159563 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-5b1b6f49-603a-46e9-ba15-84e752f27ee9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:24.160139 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-5b1b6f49-603a-46e9-ba15-84e752f27ee9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:24.166860 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5b1b6f49-603a-46e9-ba15-84e752f27ee9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:24.167279 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5b1b6f49-603a-46e9-ba15-84e752f27ee9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:24.167711 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5b1b6f49-603a-46e9-ba15-84e752f27ee9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:24.168396 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5b1b6f49-603a-46e9-ba15-84e752f27ee9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:24.168843 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5b1b6f49-603a-46e9-ba15-84e752f27ee9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:24.169273 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5b1b6f49-603a-46e9-ba15-84e752f27ee9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:24.193325 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-5b1b6f49-603a-46e9-ba15-84e752f27ee9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Going to try to terminate instance {{(pid=127113) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 07:45:24.269141 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-5b1b6f49-603a-46e9-ba15-84e752f27ee9 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 204 len: 0 microversion: 2.1 time: 0.113991 Aug 24 07:45:24.270013 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 316/638] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 24 07:45:24 2022] DELETE /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 07:45:24.278046 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-63694cdf-7bd4-4d89-83b5-404fafcd2964 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:24.278806 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-63694cdf-7bd4-4d89-83b5-404fafcd2964 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:24.285332 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-63694cdf-7bd4-4d89-83b5-404fafcd2964 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:24.285799 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-63694cdf-7bd4-4d89-83b5-404fafcd2964 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:24.286231 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-63694cdf-7bd4-4d89-83b5-404fafcd2964 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:24.286951 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-63694cdf-7bd4-4d89-83b5-404fafcd2964 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:24.287418 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-63694cdf-7bd4-4d89-83b5-404fafcd2964 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:24.287814 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-63694cdf-7bd4-4d89-83b5-404fafcd2964 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:24.418673 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-63694cdf-7bd4-4d89-83b5-404fafcd2964 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:24.426527 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-63694cdf-7bd4-4d89-83b5-404fafcd2964 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1522 microversion: 2.1 time: 0.152362 Aug 24 07:45:24.427170 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 323/639] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:45:24 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:45:25.452604 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-1a5a26f1-0ff6-4fac-9909-8345555d601d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:25.453290 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-1a5a26f1-0ff6-4fac-9909-8345555d601d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:25.459815 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1a5a26f1-0ff6-4fac-9909-8345555d601d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:25.460288 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1a5a26f1-0ff6-4fac-9909-8345555d601d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:25.460710 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1a5a26f1-0ff6-4fac-9909-8345555d601d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:25.461381 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1a5a26f1-0ff6-4fac-9909-8345555d601d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:25.461819 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1a5a26f1-0ff6-4fac-9909-8345555d601d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:25.462231 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1a5a26f1-0ff6-4fac-9909-8345555d601d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:25.593791 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-1a5a26f1-0ff6-4fac-9909-8345555d601d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:25.601386 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-1a5a26f1-0ff6-4fac-9909-8345555d601d tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1522 microversion: 2.1 time: 0.158377 Aug 24 07:45:25.601930 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 317/640] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:45:25 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:45:26.622911 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-0f9bd520-0f26-4d70-addc-1975152eaadb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:26.623508 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-0f9bd520-0f26-4d70-addc-1975152eaadb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:26.630130 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0f9bd520-0f26-4d70-addc-1975152eaadb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:26.630603 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0f9bd520-0f26-4d70-addc-1975152eaadb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:26.631054 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0f9bd520-0f26-4d70-addc-1975152eaadb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:26.631725 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0f9bd520-0f26-4d70-addc-1975152eaadb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:26.632170 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0f9bd520-0f26-4d70-addc-1975152eaadb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:26.632583 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0f9bd520-0f26-4d70-addc-1975152eaadb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:26.773549 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-0f9bd520-0f26-4d70-addc-1975152eaadb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:26.781065 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-0f9bd520-0f26-4d70-addc-1975152eaadb tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1522 microversion: 2.1 time: 0.162298 Aug 24 07:45:26.781611 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 324/641] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:45:26 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:45:27.802677 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-59083988-fbee-436a-8872-6d39f44880dc tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:27.803295 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-59083988-fbee-436a-8872-6d39f44880dc tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:27.809805 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-59083988-fbee-436a-8872-6d39f44880dc tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:27.810283 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-59083988-fbee-436a-8872-6d39f44880dc tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:27.811229 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-59083988-fbee-436a-8872-6d39f44880dc tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:27.811421 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-59083988-fbee-436a-8872-6d39f44880dc tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:27.811871 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-59083988-fbee-436a-8872-6d39f44880dc tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:27.812297 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-59083988-fbee-436a-8872-6d39f44880dc tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:27.940662 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-59083988-fbee-436a-8872-6d39f44880dc tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea609a2504e64f6f9380061080976a6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5672bdc355c4f63885138bd9c7f3497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:27.948201 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-59083988-fbee-436a-8872-6d39f44880dc tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 200 len: 1522 microversion: 2.1 time: 0.150121 Aug 24 07:45:27.948760 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 318/642] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:45:27 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:45:28.160798 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [req-d9eecb06-648f-4aa9-b799-b058e40c8890 req-f818a567-df9f-4480-8319-96c8a3276414 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2efe00bb-3dbb-42d6-82ac-4f1045ec5f33", "name": "network-vif-deleted", "tag": "7f4ca84b-7881-415a-92f9-9842d6f229c4"}]} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:45:28.175238 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-d9eecb06-648f-4aa9-b799-b058e40c8890 req-f818a567-df9f-4480-8319-96c8a3276414 service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:28.175871 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-d9eecb06-648f-4aa9-b799-b058e40c8890 req-f818a567-df9f-4480-8319-96c8a3276414 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:28.176515 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-d9eecb06-648f-4aa9-b799-b058e40c8890 req-f818a567-df9f-4480-8319-96c8a3276414 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:28.180878 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell1:SELECT=100 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:28.190030 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.compute.server_external_events [req-d9eecb06-648f-4aa9-b799-b058e40c8890 req-f818a567-df9f-4480-8319-96c8a3276414 service nova] Creating event network-vif-deleted:7f4ca84b-7881-415a-92f9-9842d6f229c4 for instance 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 on hv-cinder-85427 Aug 24 07:45:28.195404 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [req-d9eecb06-648f-4aa9-b799-b058e40c8890 req-f818a567-df9f-4480-8319-96c8a3276414 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038887 Aug 24 07:45:28.195980 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 325/643] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:45:28.969124 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-aaedd8ad-eddd-4f13-8230-ef89854d67c8 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:28.970463 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-aaedd8ad-eddd-4f13-8230-ef89854d67c8 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] [instance: 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:28.976838 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-aaedd8ad-eddd-4f13-8230-ef89854d67c8 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:28.977308 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-aaedd8ad-eddd-4f13-8230-ef89854d67c8 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:28.977736 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-aaedd8ad-eddd-4f13-8230-ef89854d67c8 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:28.978413 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-aaedd8ad-eddd-4f13-8230-ef89854d67c8 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:28.978890 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-aaedd8ad-eddd-4f13-8230-ef89854d67c8 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:28.979307 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-aaedd8ad-eddd-4f13-8230-ef89854d67c8 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:28.992117 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.wsgi [None req-aaedd8ad-eddd-4f13-8230-ef89854d67c8 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] HTTP exception thrown: Instance 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 could not be found. Aug 24 07:45:28.993705 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-aaedd8ad-eddd-4f13-8230-ef89854d67c8 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Request method failure captured: Aug 24 07:45:28.993705 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: request: GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 HTTP/1.1 Aug 24 07:45:28.993705 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept: application/json Aug 24 07:45:28.993705 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept-Encoding: identity Aug 24 07:45:28.993705 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Connection: close Aug 24 07:45:28.993705 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Length: 0 Aug 24 07:45:28.993705 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Type: application/json Aug 24 07:45:28.993705 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Host: 10.222.0.42 Aug 24 07:45:28.993705 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Openstack-System-Scope: None Aug 24 07:45:28.993705 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: User-Agent: python-urllib3/1.26.11 Aug 24 07:45:28.993705 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Auth-Token: gAAAAABjBdXj3OPdwVwNOikGz1pZEgQOCeh4GEqP5ntGxH9tZbilOI8irB2hmt3_ZpPS8CXIWEa2XHNjlUSveY2TpFHTN1ywO6y85GK4OQMHI4fYrZV7Il0xWKACBF1PBAEg2tFw9XsIk_TQrLA7G9okeYuatkKWc1A69fCtYrVWLZK-735LZbU Aug 24 07:45:28.993705 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Id: None Aug 24 07:45:28.993705 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Name: None Aug 24 07:45:28.993705 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Identity-Status: Confirmed Aug 24 07:45:28.993705 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Is-Admin-Project: True Aug 24 07:45:28.993705 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Id: default Aug 24 07:45:28.993705 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Name: Default Aug 24 07:45:28.993705 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Id: d5672bdc355c4f63885138bd9c7f3497 Aug 24 07:45:28.993705 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1449296042 Aug 24 07:45:28.993705 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Role: reader,member Aug 24 07:45:28.993705 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Roles: reader,member Aug 24 07:45:28.995336 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d5672bdc355c4f63885138bd9c7f3497"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d5672bdc355c4f63885138bd9c7f3497", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d5672bdc355c4f63885138bd9c7f3497"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d5672bdc355c4f63885138bd9c7f3497"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:45:28.995336 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1449296042 Aug 24 07:45:28.995336 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Id: d5672bdc355c4f63885138bd9c7f3497 Aug 24 07:45:28.995336 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1449296042 Aug 24 07:45:28.995336 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User: tempest-ServerRescueNegativeTestJSON-1449296042-project Aug 24 07:45:28.995336 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Id: default Aug 24 07:45:28.995336 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Name: Default Aug 24 07:45:28.995336 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Id: ea609a2504e64f6f9380061080976a6e Aug 24 07:45:28.995336 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1449296042-project Aug 24 07:45:28.995336 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: method: > Aug 24 07:45:28.995336 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: exception: Instance 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 could not be found. Aug 24 07:45:28.995336 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: action_args: {'id': '2efe00bb-3dbb-42d6-82ac-4f1045ec5f33'} Aug 24 07:45:28.996228 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:45:28.996228 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:45:28.996228 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:45:28.996228 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:45:28.996228 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:45:28.996228 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:45:28.996228 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:45:28.996228 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:45:28.996228 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:45:28.996228 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:45:28.996228 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 could not be found. Aug 24 07:45:28.996228 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:45:28.996228 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:45:28.996228 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:45:28.996228 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:45:28.996228 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:45:28.996228 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:45:28.996228 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:45:28.996228 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:45:28.996228 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:45:28.997706 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:45:28.997706 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 07:45:28.997706 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 07:45:28.997706 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:45:28.997706 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:45:28.997706 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:45:28.997706 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:45:28.997706 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 could not be found. Aug 24 07:45:28.997706 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:45:28.997706 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:45:28.997706 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:45:28.997706 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:45:28.997706 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:45:28.997706 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:45:28.997706 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:45:28.997706 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:45:28.997706 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 could not be found. Aug 24 07:45:28.997706 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:45:28.999070 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-aaedd8ad-eddd-4f13-8230-ef89854d67c8 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] Returning 404 to user: Instance 2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 could not be found. {{(pid=127113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:45:28.999070 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-aaedd8ad-eddd-4f13-8230-ef89854d67c8 tempest-ServerRescueNegativeTestJSON-1449296042 tempest-ServerRescueNegativeTestJSON-1449296042-project] 10.222.0.42 "GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33" status: 404 len: 111 microversion: 2.1 time: 0.030180 Aug 24 07:45:28.999070 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 319/644] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:45:28 2022] GET /compute/v2.1/servers/2efe00bb-3dbb-42d6-82ac-4f1045ec5f33 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:45:37.241629 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-02313fb2-052d-4af0-89c0-3732826dfcb8 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Action: 'create', calling method: .version_select at 0x7faf68596d30>, body: {"keypair": {"name": "tempest-keypair-1301067892", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVQUZUIldKr757ApcjNMi9sy40GgGBURd3lwWLdn4SYEeQjU18txTy5g/r7FnWcsRMwQv6NYjv6wr0bPZT2+OFHdOEhYsdESYlbgb/q5kFaLqOXGhgbevy9WOyi2dKyYw=="}} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:45:37.247022 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:37.275269 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.quota [None req-02313fb2-052d-4af0-89c0-3732826dfcb8 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Getting quotas for project 337840b04c0b4135a83063dfc5dbe5f1. Resources: {'key_pairs'} {{(pid=127114) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:45:37.280168 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.quota [None req-02313fb2-052d-4af0-89c0-3732826dfcb8 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Getting quotas for user a986ecc6e2644db8be8958b1eacfd5d6 and project 337840b04c0b4135a83063dfc5dbe5f1. Resources: {'key_pairs'} {{(pid=127114) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:45:37.303948 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-02313fb2-052d-4af0-89c0-3732826dfcb8 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.177568 Aug 24 07:45:37.304654 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 326/645] 10.222.0.42 () {62 vars in 1200 bytes} [Wed Aug 24 07:45:37 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 179 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 07:45:38.620646 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-8bbc4adc-e5d1-47b3-bba1-79dc88f516ec tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-941768089", "imageRef": "4358f547-a499-43f3-9c84-925d78cd73db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "69ae7914-d436-40d2-8731-86f4a5b9b674"}], "security_groups": [{"name": "tempest-securitygroup--1612314473"}], "key_name": "tempest-keypair-1301067892", "user_data": "}} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:45:38.628902 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=3 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:38.725758 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.network.neutron [None req-8bbc4adc-e5d1-47b3-bba1-79dc88f516ec tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] validate_networks() for [('69ae7914-d436-40d2-8731-86f4a5b9b674', None, None, None, None, None)] {{(pid=127113) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 07:45:38.984434 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:39.149715 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.virt.hardware [None req-8bbc4adc-e5d1-47b3-bba1-79dc88f516ec tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Flavor limits 0:0:0 {{(pid=127113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 07:45:39.150158 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.virt.hardware [None req-8bbc4adc-e5d1-47b3-bba1-79dc88f516ec tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Image limits 0:0:0 {{(pid=127113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 07:45:39.150617 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.virt.hardware [None req-8bbc4adc-e5d1-47b3-bba1-79dc88f516ec tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Flavor pref 0:0:0 {{(pid=127113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 07:45:39.151060 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.virt.hardware [None req-8bbc4adc-e5d1-47b3-bba1-79dc88f516ec tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Image pref 0:0:0 {{(pid=127113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 07:45:39.151464 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.virt.hardware [None req-8bbc4adc-e5d1-47b3-bba1-79dc88f516ec tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 07:45:39.160999 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8bbc4adc-e5d1-47b3-bba1-79dc88f516ec tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:39.161466 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8bbc4adc-e5d1-47b3-bba1-79dc88f516ec tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:39.161890 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8bbc4adc-e5d1-47b3-bba1-79dc88f516ec tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:39.162595 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8bbc4adc-e5d1-47b3-bba1-79dc88f516ec tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:39.163083 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8bbc4adc-e5d1-47b3-bba1-79dc88f516ec tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:39.163496 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8bbc4adc-e5d1-47b3-bba1-79dc88f516ec tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:39.180041 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.quota [None req-8bbc4adc-e5d1-47b3-bba1-79dc88f516ec tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Getting quotas for project 337840b04c0b4135a83063dfc5dbe5f1. Resources: {'cores', 'ram', 'instances'} {{(pid=127113) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:45:39.183916 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.quota [None req-8bbc4adc-e5d1-47b3-bba1-79dc88f516ec tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Getting quotas for user a986ecc6e2644db8be8958b1eacfd5d6 and project 337840b04c0b4135a83063dfc5dbe5f1. Resources: {'cores', 'ram', 'instances'} {{(pid=127113) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:45:39.194479 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-8bbc4adc-e5d1-47b3-bba1-79dc88f516ec tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Going to run 1 instances... {{(pid=127113) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 07:45:39.196782 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-8bbc4adc-e5d1-47b3-bba1-79dc88f516ec tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4358f547-a499-43f3-9c84-925d78cd73db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127113) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 07:45:39.245181 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-8bbc4adc-e5d1-47b3-bba1-79dc88f516ec tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.628988 Aug 24 07:45:39.246061 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 320/646] 10.222.0.42 () {62 vars in 1188 bytes} [Wed Aug 24 07:45:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 07:45:39.257343 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-dcc2a016-96fe-448d-8154-89d638a7c6d2 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:39.258632 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-dcc2a016-96fe-448d-8154-89d638a7c6d2 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:39.323789 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-dcc2a016-96fe-448d-8154-89d638a7c6d2 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:39.333057 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-dcc2a016-96fe-448d-8154-89d638a7c6d2 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:39.334607 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-dcc2a016-96fe-448d-8154-89d638a7c6d2 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:39.335740 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-dcc2a016-96fe-448d-8154-89d638a7c6d2 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1281 microversion: 2.20 time: 0.082764 Aug 24 07:45:39.346879 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 327/647] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:45:39 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1281 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:45:40.361854 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-ed39b1d6-1943-4f45-9d67-2bc37ebc272e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:40.362521 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-ed39b1d6-1943-4f45-9d67-2bc37ebc272e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:40.369405 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ed39b1d6-1943-4f45-9d67-2bc37ebc272e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:40.369895 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ed39b1d6-1943-4f45-9d67-2bc37ebc272e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:40.370491 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ed39b1d6-1943-4f45-9d67-2bc37ebc272e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:40.371225 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ed39b1d6-1943-4f45-9d67-2bc37ebc272e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:40.371767 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ed39b1d6-1943-4f45-9d67-2bc37ebc272e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:40.372738 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ed39b1d6-1943-4f45-9d67-2bc37ebc272e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:40.452809 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-ed39b1d6-1943-4f45-9d67-2bc37ebc272e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:40.466687 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-ed39b1d6-1943-4f45-9d67-2bc37ebc272e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:40.468693 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-ed39b1d6-1943-4f45-9d67-2bc37ebc272e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:40.469838 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-ed39b1d6-1943-4f45-9d67-2bc37ebc272e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1333 microversion: 2.20 time: 0.112399 Aug 24 07:45:40.470833 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 321/648] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:45:40 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1333 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:45:40.980566 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-3c04330b-3c1a-4d43-8eca-e4a45646443c tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:40.981682 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-3c04330b-3c1a-4d43-8eca-e4a45646443c tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 13cb624d-3028-4eaf-b4df-2983595448a0] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:40.989004 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3c04330b-3c1a-4d43-8eca-e4a45646443c tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:40.989725 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3c04330b-3c1a-4d43-8eca-e4a45646443c tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:40.990353 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3c04330b-3c1a-4d43-8eca-e4a45646443c tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:40.991285 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3c04330b-3c1a-4d43-8eca-e4a45646443c tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:40.991749 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3c04330b-3c1a-4d43-8eca-e4a45646443c tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:40.992911 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3c04330b-3c1a-4d43-8eca-e4a45646443c tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:41.016933 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-3c04330b-3c1a-4d43-8eca-e4a45646443c tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0/ips" status: 200 len: 147 microversion: 2.1 time: 0.158423 Aug 24 07:45:41.017936 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 328/649] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Aug 24 07:45:40 2022] GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0/ips => generated 147 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:45:41.492162 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-829dbf22-fa35-46ce-914b-1270300a419d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:41.492760 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-829dbf22-fa35-46ce-914b-1270300a419d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:41.499080 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-829dbf22-fa35-46ce-914b-1270300a419d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:41.499650 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-829dbf22-fa35-46ce-914b-1270300a419d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:41.500078 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-829dbf22-fa35-46ce-914b-1270300a419d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:41.501047 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-829dbf22-fa35-46ce-914b-1270300a419d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:41.501529 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-829dbf22-fa35-46ce-914b-1270300a419d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:41.501995 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-829dbf22-fa35-46ce-914b-1270300a419d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:41.651701 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-829dbf22-fa35-46ce-914b-1270300a419d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:41.661317 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-829dbf22-fa35-46ce-914b-1270300a419d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:41.662870 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-829dbf22-fa35-46ce-914b-1270300a419d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:41.664246 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-829dbf22-fa35-46ce-914b-1270300a419d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1407 microversion: 2.20 time: 0.175954 Aug 24 07:45:41.665133 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 322/650] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:45:41 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:45:42.197732 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [req-72576ea6-d4f1-4467-8313-674ad70c1734 req-6aacdca6-5676-4f50-9d08-a726d37580e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a80b309c-fa06-43b7-be57-1dc3045b9651", "tag": "581e55c1-7b9e-4284-8d45-c0506fd756f1"}]} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:45:42.207695 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-72576ea6-d4f1-4467-8313-674ad70c1734 req-6aacdca6-5676-4f50-9d08-a726d37580e2 service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:42.208176 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-72576ea6-d4f1-4467-8313-674ad70c1734 req-6aacdca6-5676-4f50-9d08-a726d37580e2 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:42.208605 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-72576ea6-d4f1-4467-8313-674ad70c1734 req-6aacdca6-5676-4f50-9d08-a726d37580e2 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:42.219270 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.compute.server_external_events [req-72576ea6-d4f1-4467-8313-674ad70c1734 req-6aacdca6-5676-4f50-9d08-a726d37580e2 service nova] Creating event network-changed:581e55c1-7b9e-4284-8d45-c0506fd756f1 for instance a80b309c-fa06-43b7-be57-1dc3045b9651 on hv-cinder-85427 Aug 24 07:45:42.225265 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [req-72576ea6-d4f1-4467-8313-674ad70c1734 req-6aacdca6-5676-4f50-9d08-a726d37580e2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092095 Aug 24 07:45:42.225866 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 329/651] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:45:42.396475 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-095a849f-c58c-4532-8c34-6b607c6fce4f tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca503310-b75f-4a98-b50d-8ddd8d8dea51"}} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:45:42.399096 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-095a849f-c58c-4532-8c34-6b607c6fce4f tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 13cb624d-3028-4eaf-b4df-2983595448a0] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:42.405808 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-095a849f-c58c-4532-8c34-6b607c6fce4f tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:42.406301 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-095a849f-c58c-4532-8c34-6b607c6fce4f tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:42.406772 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-095a849f-c58c-4532-8c34-6b607c6fce4f tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:42.408024 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-095a849f-c58c-4532-8c34-6b607c6fce4f tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:42.408491 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-095a849f-c58c-4532-8c34-6b607c6fce4f tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:42.408914 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-095a849f-c58c-4532-8c34-6b607c6fce4f tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:42.661116 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-095a849f-c58c-4532-8c34-6b607c6fce4f tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "POST /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268960 Aug 24 07:45:42.661757 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 323/652] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Aug 24 07:45:42 2022] POST /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:45:42.686947 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-1488c2c0-343e-459d-a243-027ed803eed4 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:42.687639 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-1488c2c0-343e-459d-a243-027ed803eed4 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:42.693789 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1488c2c0-343e-459d-a243-027ed803eed4 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:42.694265 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1488c2c0-343e-459d-a243-027ed803eed4 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:42.694721 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1488c2c0-343e-459d-a243-027ed803eed4 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:42.695408 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1488c2c0-343e-459d-a243-027ed803eed4 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:42.695859 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1488c2c0-343e-459d-a243-027ed803eed4 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:42.696275 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1488c2c0-343e-459d-a243-027ed803eed4 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:42.830818 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-1488c2c0-343e-459d-a243-027ed803eed4 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:42.839011 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-1488c2c0-343e-459d-a243-027ed803eed4 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:42.840515 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-1488c2c0-343e-459d-a243-027ed803eed4 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:42.841614 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-1488c2c0-343e-459d-a243-027ed803eed4 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1407 microversion: 2.20 time: 0.158874 Aug 24 07:45:42.842161 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 330/653] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:45:42 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:45:43.503749 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-32cd689b-fb50-4cf8-861c-6366439454dd tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:43.504418 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-32cd689b-fb50-4cf8-861c-6366439454dd tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: b0139656-99b6-4568-8fc1-61ac16df46d1] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:43.510479 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-32cd689b-fb50-4cf8-861c-6366439454dd tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:43.511073 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-32cd689b-fb50-4cf8-861c-6366439454dd tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:43.511504 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-32cd689b-fb50-4cf8-861c-6366439454dd tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:43.512201 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-32cd689b-fb50-4cf8-861c-6366439454dd tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:43.512651 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-32cd689b-fb50-4cf8-861c-6366439454dd tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:43.513125 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-32cd689b-fb50-4cf8-861c-6366439454dd tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:43.536610 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-32cd689b-fb50-4cf8-861c-6366439454dd tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1/ips" status: 200 len: 149 microversion: 2.1 time: 0.038555 Aug 24 07:45:43.537178 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 324/654] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Aug 24 07:45:43 2022] GET /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:45:43.864194 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-e671e1e1-47a9-4940-98c8-b9649b9a614d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:43.864867 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-e671e1e1-47a9-4940-98c8-b9649b9a614d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:43.872142 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e671e1e1-47a9-4940-98c8-b9649b9a614d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:43.872683 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e671e1e1-47a9-4940-98c8-b9649b9a614d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:43.873297 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e671e1e1-47a9-4940-98c8-b9649b9a614d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:43.874113 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e671e1e1-47a9-4940-98c8-b9649b9a614d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:43.874579 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e671e1e1-47a9-4940-98c8-b9649b9a614d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:43.875160 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e671e1e1-47a9-4940-98c8-b9649b9a614d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:44.098753 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-e671e1e1-47a9-4940-98c8-b9649b9a614d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:44.107031 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-e671e1e1-47a9-4940-98c8-b9649b9a614d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:44.108540 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-e671e1e1-47a9-4940-98c8-b9649b9a614d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:44.109769 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-e671e1e1-47a9-4940-98c8-b9649b9a614d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1407 microversion: 2.20 time: 0.250499 Aug 24 07:45:44.110324 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 331/655] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:45:43 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1407 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:45:44.951035 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-b4839cd3-a428-4ecd-beb9-13af364ddf71 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b8b8666b-ee4c-4349-883a-b56cdc17dfeb"}} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:45:44.953421 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-b4839cd3-a428-4ecd-beb9-13af364ddf71 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: b0139656-99b6-4568-8fc1-61ac16df46d1] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:44.960527 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b4839cd3-a428-4ecd-beb9-13af364ddf71 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:44.961010 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b4839cd3-a428-4ecd-beb9-13af364ddf71 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:44.961441 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b4839cd3-a428-4ecd-beb9-13af364ddf71 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:44.962126 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b4839cd3-a428-4ecd-beb9-13af364ddf71 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:44.962584 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b4839cd3-a428-4ecd-beb9-13af364ddf71 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:44.963029 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b4839cd3-a428-4ecd-beb9-13af364ddf71 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:45.132942 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-0d85e08d-c244-4532-afde-f14dbf743bcf tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:45.133540 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-0d85e08d-c244-4532-afde-f14dbf743bcf tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:45.139885 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0d85e08d-c244-4532-afde-f14dbf743bcf tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:45.140329 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0d85e08d-c244-4532-afde-f14dbf743bcf tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:45.140753 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0d85e08d-c244-4532-afde-f14dbf743bcf tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:45.141415 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0d85e08d-c244-4532-afde-f14dbf743bcf tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:45.141865 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0d85e08d-c244-4532-afde-f14dbf743bcf tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:45.142267 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0d85e08d-c244-4532-afde-f14dbf743bcf tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:45.202469 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-b4839cd3-a428-4ecd-beb9-13af364ddf71 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "POST /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255294 Aug 24 07:45:45.203130 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 325/656] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Aug 24 07:45:44 2022] POST /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:45:45.279792 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-0d85e08d-c244-4532-afde-f14dbf743bcf tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:45.287958 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-0d85e08d-c244-4532-afde-f14dbf743bcf tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:45.289448 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-0d85e08d-c244-4532-afde-f14dbf743bcf tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:45.290532 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-0d85e08d-c244-4532-afde-f14dbf743bcf tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1407 microversion: 2.20 time: 0.161466 Aug 24 07:45:45.291107 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 332/657] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:45:45 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 07:45:46.314843 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-563395da-58b3-4c9d-a91a-d28abd05afe6 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:46.315543 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-563395da-58b3-4c9d-a91a-d28abd05afe6 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:46.322196 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-563395da-58b3-4c9d-a91a-d28abd05afe6 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:46.322987 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-563395da-58b3-4c9d-a91a-d28abd05afe6 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:46.323618 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-563395da-58b3-4c9d-a91a-d28abd05afe6 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:46.324829 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-563395da-58b3-4c9d-a91a-d28abd05afe6 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:46.325692 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-563395da-58b3-4c9d-a91a-d28abd05afe6 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:46.326231 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-563395da-58b3-4c9d-a91a-d28abd05afe6 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:46.450993 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-563395da-58b3-4c9d-a91a-d28abd05afe6 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:46.459498 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-563395da-58b3-4c9d-a91a-d28abd05afe6 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:46.460992 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-563395da-58b3-4c9d-a91a-d28abd05afe6 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:46.462081 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-563395da-58b3-4c9d-a91a-d28abd05afe6 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1407 microversion: 2.20 time: 0.152550 Aug 24 07:45:46.462629 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 326/658] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:45:46 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:45:47.483982 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-cc2a3521-31c6-4085-9e12-a8dfcdf23a5d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:47.484613 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-cc2a3521-31c6-4085-9e12-a8dfcdf23a5d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:47.492171 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cc2a3521-31c6-4085-9e12-a8dfcdf23a5d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:47.492749 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cc2a3521-31c6-4085-9e12-a8dfcdf23a5d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:47.493255 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cc2a3521-31c6-4085-9e12-a8dfcdf23a5d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:47.493985 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cc2a3521-31c6-4085-9e12-a8dfcdf23a5d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:47.494411 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cc2a3521-31c6-4085-9e12-a8dfcdf23a5d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:47.494858 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cc2a3521-31c6-4085-9e12-a8dfcdf23a5d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:47.624769 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-cc2a3521-31c6-4085-9e12-a8dfcdf23a5d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:47.633686 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-cc2a3521-31c6-4085-9e12-a8dfcdf23a5d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:47.635219 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-cc2a3521-31c6-4085-9e12-a8dfcdf23a5d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:47.636328 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-cc2a3521-31c6-4085-9e12-a8dfcdf23a5d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1407 microversion: 2.20 time: 0.156396 Aug 24 07:45:47.636885 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 333/659] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:45:47 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:45:47.824163 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [req-e036df0b-0dcc-4727-ad41-be48770753c9 req-3d48a152-e791-4bfd-b952-6f6cece35c7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a80b309c-fa06-43b7-be57-1dc3045b9651", "name": "network-vif-plugged", "status": "completed", "tag": "581e55c1-7b9e-4284-8d45-c0506fd756f1"}]} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:45:47.835002 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-e036df0b-0dcc-4727-ad41-be48770753c9 req-3d48a152-e791-4bfd-b952-6f6cece35c7f service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:47.835417 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-e036df0b-0dcc-4727-ad41-be48770753c9 req-3d48a152-e791-4bfd-b952-6f6cece35c7f service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:47.835842 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-e036df0b-0dcc-4727-ad41-be48770753c9 req-3d48a152-e791-4bfd-b952-6f6cece35c7f service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:47.847385 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.compute.server_external_events [req-e036df0b-0dcc-4727-ad41-be48770753c9 req-3d48a152-e791-4bfd-b952-6f6cece35c7f service nova] Creating event network-vif-plugged:581e55c1-7b9e-4284-8d45-c0506fd756f1 for instance a80b309c-fa06-43b7-be57-1dc3045b9651 on hv-cinder-85427 Aug 24 07:45:47.852123 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [req-e036df0b-0dcc-4727-ad41-be48770753c9 req-3d48a152-e791-4bfd-b952-6f6cece35c7f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093818 Aug 24 07:45:47.852760 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 327/660] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:45:48.659271 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-4b8f7d5b-fcb8-4298-9331-1c81d23bc2f7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:48.659820 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-4b8f7d5b-fcb8-4298-9331-1c81d23bc2f7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:48.666218 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4b8f7d5b-fcb8-4298-9331-1c81d23bc2f7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:48.666718 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4b8f7d5b-fcb8-4298-9331-1c81d23bc2f7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:48.667162 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4b8f7d5b-fcb8-4298-9331-1c81d23bc2f7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:48.667852 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4b8f7d5b-fcb8-4298-9331-1c81d23bc2f7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:48.668305 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4b8f7d5b-fcb8-4298-9331-1c81d23bc2f7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:48.668730 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4b8f7d5b-fcb8-4298-9331-1c81d23bc2f7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:48.801400 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-4b8f7d5b-fcb8-4298-9331-1c81d23bc2f7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:48.809425 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-4b8f7d5b-fcb8-4298-9331-1c81d23bc2f7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:48.811020 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-4b8f7d5b-fcb8-4298-9331-1c81d23bc2f7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:48.812131 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-4b8f7d5b-fcb8-4298-9331-1c81d23bc2f7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1407 microversion: 2.20 time: 0.156854 Aug 24 07:45:48.812691 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 334/661] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:45:48 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:45:49.832944 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell0:SELECT=2 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:49.833750 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell0:SELECT=6 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:49.838645 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-cf47e15b-6a6c-4a14-bb21-dc500a970299 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:49.839311 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-cf47e15b-6a6c-4a14-bb21-dc500a970299 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:49.846864 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-cf47e15b-6a6c-4a14-bb21-dc500a970299 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:49.847343 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-cf47e15b-6a6c-4a14-bb21-dc500a970299 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:49.847773 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-cf47e15b-6a6c-4a14-bb21-dc500a970299 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:49.848453 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-cf47e15b-6a6c-4a14-bb21-dc500a970299 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:49.848901 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-cf47e15b-6a6c-4a14-bb21-dc500a970299 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:49.849317 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-cf47e15b-6a6c-4a14-bb21-dc500a970299 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:49.980688 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-cf47e15b-6a6c-4a14-bb21-dc500a970299 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:49.988702 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-cf47e15b-6a6c-4a14-bb21-dc500a970299 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:49.990258 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-cf47e15b-6a6c-4a14-bb21-dc500a970299 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:45:49.991427 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-cf47e15b-6a6c-4a14-bb21-dc500a970299 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1599 microversion: 2.20 time: 0.160174 Aug 24 07:45:49.991982 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 328/662] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:45:49 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1599 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:45:50.013310 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-54ab7428-0589-43cf-a92a-2055718c7efe tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:50.013824 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-54ab7428-0589-43cf-a92a-2055718c7efe tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:50.015744 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell0:SELECT=6 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:45:50.022027 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-54ab7428-0589-43cf-a92a-2055718c7efe tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:50.022507 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-54ab7428-0589-43cf-a92a-2055718c7efe tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:50.022962 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-54ab7428-0589-43cf-a92a-2055718c7efe tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:50.023657 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-54ab7428-0589-43cf-a92a-2055718c7efe tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:50.024106 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-54ab7428-0589-43cf-a92a-2055718c7efe tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:50.024528 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-54ab7428-0589-43cf-a92a-2055718c7efe tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:50.102824 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-54ab7428-0589-43cf-a92a-2055718c7efe tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.093360 Aug 24 07:45:50.103444 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 335/663] 10.222.0.42 () {60 vars in 1316 bytes} [Wed Aug 24 07:45:50 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 07:45:51.039440 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [req-a87db88b-0ce5-4d33-a735-b18a5d8d944b req-5de9be93-5a49-4e59-b2aa-2a7e34be3ef8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a80b309c-fa06-43b7-be57-1dc3045b9651", "tag": "581e55c1-7b9e-4284-8d45-c0506fd756f1"}]} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:45:51.049960 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-a87db88b-0ce5-4d33-a735-b18a5d8d944b req-5de9be93-5a49-4e59-b2aa-2a7e34be3ef8 service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:51.050439 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-a87db88b-0ce5-4d33-a735-b18a5d8d944b req-5de9be93-5a49-4e59-b2aa-2a7e34be3ef8 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:51.050963 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-a87db88b-0ce5-4d33-a735-b18a5d8d944b req-5de9be93-5a49-4e59-b2aa-2a7e34be3ef8 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:51.061799 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.compute.server_external_events [req-a87db88b-0ce5-4d33-a735-b18a5d8d944b req-5de9be93-5a49-4e59-b2aa-2a7e34be3ef8 service nova] Creating event network-changed:581e55c1-7b9e-4284-8d45-c0506fd756f1 for instance a80b309c-fa06-43b7-be57-1dc3045b9651 on hv-cinder-85427 Aug 24 07:45:51.066895 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [req-a87db88b-0ce5-4d33-a735-b18a5d8d944b req-5de9be93-5a49-4e59-b2aa-2a7e34be3ef8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030971 Aug 24 07:45:51.067455 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 329/664] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:45:51.296944 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-be4fe81c-1e9b-4679-ab4b-530a1602c51c tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:51.299549 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-be4fe81c-1e9b-4679-ab4b-530a1602c51c tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 13cb624d-3028-4eaf-b4df-2983595448a0] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:51.305793 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-be4fe81c-1e9b-4679-ab4b-530a1602c51c tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:51.306278 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-be4fe81c-1e9b-4679-ab4b-530a1602c51c tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:51.306735 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-be4fe81c-1e9b-4679-ab4b-530a1602c51c tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:51.307659 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-be4fe81c-1e9b-4679-ab4b-530a1602c51c tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:51.308115 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-be4fe81c-1e9b-4679-ab4b-530a1602c51c tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:51.308542 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-be4fe81c-1e9b-4679-ab4b-530a1602c51c tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:51.339240 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-be4fe81c-1e9b-4679-ab4b-530a1602c51c tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046612 Aug 24 07:45:51.339800 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 336/665] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 24 07:45:51 2022] GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:45:51.354540 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-0b39b1a5-a636-422c-94aa-ec7dee6bffb7 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:51.355159 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-0b39b1a5-a636-422c-94aa-ec7dee6bffb7 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 13cb624d-3028-4eaf-b4df-2983595448a0] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:51.361450 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0b39b1a5-a636-422c-94aa-ec7dee6bffb7 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:51.361938 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0b39b1a5-a636-422c-94aa-ec7dee6bffb7 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:51.362373 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0b39b1a5-a636-422c-94aa-ec7dee6bffb7 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:51.363111 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0b39b1a5-a636-422c-94aa-ec7dee6bffb7 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:51.363570 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0b39b1a5-a636-422c-94aa-ec7dee6bffb7 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:51.363996 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0b39b1a5-a636-422c-94aa-ec7dee6bffb7 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:51.393959 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-0b39b1a5-a636-422c-94aa-ec7dee6bffb7 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0/os-volume_attachments/ca503310-b75f-4a98-b50d-8ddd8d8dea51" status: 200 len: 194 microversion: 2.1 time: 0.046421 Aug 24 07:45:51.394555 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 330/666] 10.222.0.42 () {58 vars in 1413 bytes} [Wed Aug 24 07:45:51 2022] GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0/os-volume_attachments/ca503310-b75f-4a98-b50d-8ddd8d8dea51 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:45:52.761716 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-f9d55423-d9b0-4616-9206-bca023ee1fd1 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b06032f8-8e53-4dc2-8cee-6154a2c0fac7"}} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:45:52.764103 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-f9d55423-d9b0-4616-9206-bca023ee1fd1 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 13cb624d-3028-4eaf-b4df-2983595448a0] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:52.771103 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f9d55423-d9b0-4616-9206-bca023ee1fd1 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:52.771589 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f9d55423-d9b0-4616-9206-bca023ee1fd1 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:52.772069 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f9d55423-d9b0-4616-9206-bca023ee1fd1 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:52.772712 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f9d55423-d9b0-4616-9206-bca023ee1fd1 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:52.773254 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f9d55423-d9b0-4616-9206-bca023ee1fd1 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:52.773577 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f9d55423-d9b0-4616-9206-bca023ee1fd1 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:53.008654 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-f9d55423-d9b0-4616-9206-bca023ee1fd1 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "POST /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.250775 Aug 24 07:45:53.009258 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 337/667] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Aug 24 07:45:52 2022] POST /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0/os-volume_attachments => generated 194 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:45:56.989555 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-82c27c81-7034-47c2-bf99-3980d506638f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b8b8666b-ee4c-4349-883a-b56cdc17dfeb"}} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:45:56.992000 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-82c27c81-7034-47c2-bf99-3980d506638f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: b0139656-99b6-4568-8fc1-61ac16df46d1] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:56.998822 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-82c27c81-7034-47c2-bf99-3980d506638f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:56.999382 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-82c27c81-7034-47c2-bf99-3980d506638f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:56.999749 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-82c27c81-7034-47c2-bf99-3980d506638f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:57.000424 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-82c27c81-7034-47c2-bf99-3980d506638f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:57.000892 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-82c27c81-7034-47c2-bf99-3980d506638f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:57.001302 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-82c27c81-7034-47c2-bf99-3980d506638f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:57.079387 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.wsgi [None req-82c27c81-7034-47c2-bf99-3980d506638f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] HTTP exception thrown: Invalid volume: volume b8b8666b-ee4c-4349-883a-b56cdc17dfeb is already attached to instances: b0139656-99b6-4568-8fc1-61ac16df46d1 Aug 24 07:45:57.081183 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-82c27c81-7034-47c2-bf99-3980d506638f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Request method failure captured: Aug 24 07:45:57.081183 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: request: POST /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1/os-volume_attachments HTTP/1.1 Aug 24 07:45:57.081183 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept: application/json Aug 24 07:45:57.081183 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept-Encoding: identity Aug 24 07:45:57.081183 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Connection: close Aug 24 07:45:57.081183 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Length: 74 Aug 24 07:45:57.081183 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Type: application/json Aug 24 07:45:57.081183 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Host: 10.222.0.42 Aug 24 07:45:57.081183 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Openstack-System-Scope: None Aug 24 07:45:57.081183 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: User-Agent: python-urllib3/1.26.11 Aug 24 07:45:57.081183 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Auth-Token: gAAAAABjBdYobzFKkpFZErKGYQQ6C-XEh7i9OW8ojTbqxPVr74lckpRiFaze-efBQslsaQSX_M9uiYyghTqG7Fg_jrM-qOMOyzErIrVcNm0xIs9NgJg7VzKqJCSA-yXxsyHfCdfoLwTQ2cusI7TmXO58zoZh7YF2Ykkf3m7e8LiRBBQiO6NdfF4 Aug 24 07:45:57.081183 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Id: None Aug 24 07:45:57.081183 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Name: None Aug 24 07:45:57.081183 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Identity-Status: Confirmed Aug 24 07:45:57.081183 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Is-Admin-Project: True Aug 24 07:45:57.081183 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Id: default Aug 24 07:45:57.081183 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Name: Default Aug 24 07:45:57.081183 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Id: af5acb73124c485aa87e60b4e5d4f6d4 Aug 24 07:45:57.081183 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Name: tempest-AttachVolumeNegativeTest-1077633228 Aug 24 07:45:57.081183 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Role: reader,member Aug 24 07:45:57.081183 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Roles: reader,member Aug 24 07:45:57.082816 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af5acb73124c485aa87e60b4e5d4f6d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_af5acb73124c485aa87e60b4e5d4f6d4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af5acb73124c485aa87e60b4e5d4f6d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/af5acb73124c485aa87e60b4e5d4f6d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:45:57.082816 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant: tempest-AttachVolumeNegativeTest-1077633228 Aug 24 07:45:57.082816 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Id: af5acb73124c485aa87e60b4e5d4f6d4 Aug 24 07:45:57.082816 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1077633228 Aug 24 07:45:57.082816 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User: tempest-AttachVolumeNegativeTest-1077633228-project Aug 24 07:45:57.082816 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Id: default Aug 24 07:45:57.082816 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Name: Default Aug 24 07:45:57.082816 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Id: f594c9344b2c472ba33ceef87ec88a0b Aug 24 07:45:57.082816 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Name: tempest-AttachVolumeNegativeTest-1077633228-project Aug 24 07:45:57.082816 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Aug 24 07:45:57.082816 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: {"volumeAttachment": {"volumeId": "b8b8666b-ee4c-4349-883a-b56cdc17dfeb"}} Aug 24 07:45:57.082816 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: method: > Aug 24 07:45:57.084025 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: exception: Invalid volume: volume b8b8666b-ee4c-4349-883a-b56cdc17dfeb is already attached to instances: b0139656-99b6-4568-8fc1-61ac16df46d1 Aug 24 07:45:57.084025 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: action_args: {'server_id': 'b0139656-99b6-4568-8fc1-61ac16df46d1', 'body': {'volumeAttachment': {'volumeId': 'b8b8666b-ee4c-4349-883a-b56cdc17dfeb'}}} Aug 24 07:45:57.084025 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:45:57.084025 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:45:57.084025 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 07:45:57.084025 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 07:45:57.084025 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 07:45:57.084025 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 07:45:57.084025 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 07:45:57.084025 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 07:45:57.084025 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 07:45:57.084025 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 07:45:57.084025 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 07:45:57.084025 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 07:45:57.084025 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b8b8666b-ee4c-4349-883a-b56cdc17dfeb is already attached to instances: b0139656-99b6-4568-8fc1-61ac16df46d1 Aug 24 07:45:57.084025 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:45:57.084025 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:45:57.084025 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:45:57.084025 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:45:57.086071 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:45:57.086071 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:45:57.086071 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:45:57.086071 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:45:57.086071 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:45:57.086071 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:45:57.086071 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 07:45:57.086071 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 07:45:57.086071 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 07:45:57.086071 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 07:45:57.086071 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 07:45:57.086071 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 07:45:57.086071 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 07:45:57.086071 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 07:45:57.086071 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b8b8666b-ee4c-4349-883a-b56cdc17dfeb is already attached to instances: b0139656-99b6-4568-8fc1-61ac16df46d1 Aug 24 07:45:57.086071 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:45:57.086071 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:45:57.086071 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:45:57.086071 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:45:57.086071 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:45:57.088540 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:45:57.088540 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:45:57.088540 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:45:57.088540 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b8b8666b-ee4c-4349-883a-b56cdc17dfeb is already attached to instances: b0139656-99b6-4568-8fc1-61ac16df46d1 Aug 24 07:45:57.088540 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:45:57.088540 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-82c27c81-7034-47c2-bf99-3980d506638f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Returning 400 to user: Invalid volume: volume b8b8666b-ee4c-4349-883a-b56cdc17dfeb is already attached to instances: b0139656-99b6-4568-8fc1-61ac16df46d1 {{(pid=127113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:45:57.088540 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-82c27c81-7034-47c2-bf99-3980d506638f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "POST /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097619 Aug 24 07:45:57.088540 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 331/668] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Aug 24 07:45:56 2022] POST /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 07:45:57.152494 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-6057d300-97ad-46ba-809c-1cfd44abbd0c tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:57.153066 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-6057d300-97ad-46ba-809c-1cfd44abbd0c tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: b0139656-99b6-4568-8fc1-61ac16df46d1] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:57.161037 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6057d300-97ad-46ba-809c-1cfd44abbd0c tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:57.161649 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6057d300-97ad-46ba-809c-1cfd44abbd0c tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:57.162227 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6057d300-97ad-46ba-809c-1cfd44abbd0c tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:57.163075 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6057d300-97ad-46ba-809c-1cfd44abbd0c tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:57.163540 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6057d300-97ad-46ba-809c-1cfd44abbd0c tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:57.164058 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6057d300-97ad-46ba-809c-1cfd44abbd0c tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:57.289334 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.objects.instance [None req-6057d300-97ad-46ba-809c-1cfd44abbd0c tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lazy-loading 'services' on Instance uuid b0139656-99b6-4568-8fc1-61ac16df46d1 {{(pid=127114) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:45:57.401437 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-6057d300-97ad-46ba-809c-1cfd44abbd0c tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1/os-volume_attachments/b8b8666b-ee4c-4349-883a-b56cdc17dfeb" status: 202 len: 0 microversion: 2.1 time: 0.253762 Aug 24 07:45:57.402161 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 338/669] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Aug 24 07:45:57 2022] DELETE /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1/os-volume_attachments/b8b8666b-ee4c-4349-883a-b56cdc17dfeb => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 07:45:57.410998 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-c37e1ff6-5459-4ecf-8a8c-84af6099bd37 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:57.413212 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-c37e1ff6-5459-4ecf-8a8c-84af6099bd37 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: b0139656-99b6-4568-8fc1-61ac16df46d1] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:57.420171 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c37e1ff6-5459-4ecf-8a8c-84af6099bd37 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:57.420586 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c37e1ff6-5459-4ecf-8a8c-84af6099bd37 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:57.421015 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c37e1ff6-5459-4ecf-8a8c-84af6099bd37 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:57.421714 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c37e1ff6-5459-4ecf-8a8c-84af6099bd37 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:57.422166 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c37e1ff6-5459-4ecf-8a8c-84af6099bd37 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:57.422584 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c37e1ff6-5459-4ecf-8a8c-84af6099bd37 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:57.456343 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-c37e1ff6-5459-4ecf-8a8c-84af6099bd37 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049730 Aug 24 07:45:57.456901 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 332/670] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 24 07:45:57 2022] GET /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:45:58.469896 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-dc4a05c4-5cba-4371-90ad-4c4508595ea2 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:58.472158 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-dc4a05c4-5cba-4371-90ad-4c4508595ea2 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: b0139656-99b6-4568-8fc1-61ac16df46d1] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:58.478626 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-dc4a05c4-5cba-4371-90ad-4c4508595ea2 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:58.479177 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-dc4a05c4-5cba-4371-90ad-4c4508595ea2 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:58.479610 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-dc4a05c4-5cba-4371-90ad-4c4508595ea2 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:58.480293 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-dc4a05c4-5cba-4371-90ad-4c4508595ea2 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:58.480732 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-dc4a05c4-5cba-4371-90ad-4c4508595ea2 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:58.481143 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-dc4a05c4-5cba-4371-90ad-4c4508595ea2 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:58.510412 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-dc4a05c4-5cba-4371-90ad-4c4508595ea2 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045569 Aug 24 07:45:58.510993 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 339/671] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 24 07:45:58 2022] GET /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:45:59.522445 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-45159988-312c-4681-9002-8775d3f54019 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:45:59.524678 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-45159988-312c-4681-9002-8775d3f54019 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: b0139656-99b6-4568-8fc1-61ac16df46d1] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:45:59.530993 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-45159988-312c-4681-9002-8775d3f54019 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:59.531463 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-45159988-312c-4681-9002-8775d3f54019 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:59.531946 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-45159988-312c-4681-9002-8775d3f54019 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:59.532618 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-45159988-312c-4681-9002-8775d3f54019 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:45:59.533061 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-45159988-312c-4681-9002-8775d3f54019 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:45:59.533500 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-45159988-312c-4681-9002-8775d3f54019 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:45:59.561986 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-45159988-312c-4681-9002-8775d3f54019 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043470 Aug 24 07:45:59.562520 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 333/672] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 24 07:45:59 2022] GET /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:46:00.574639 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-12caf3c1-c730-42d1-9e37-a2b1bd665425 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:00.576795 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-12caf3c1-c730-42d1-9e37-a2b1bd665425 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: b0139656-99b6-4568-8fc1-61ac16df46d1] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:00.583858 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-12caf3c1-c730-42d1-9e37-a2b1bd665425 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:00.584335 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-12caf3c1-c730-42d1-9e37-a2b1bd665425 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:00.584764 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-12caf3c1-c730-42d1-9e37-a2b1bd665425 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:00.585495 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-12caf3c1-c730-42d1-9e37-a2b1bd665425 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:00.585945 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-12caf3c1-c730-42d1-9e37-a2b1bd665425 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:00.586362 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-12caf3c1-c730-42d1-9e37-a2b1bd665425 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:00.614449 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-12caf3c1-c730-42d1-9e37-a2b1bd665425 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043692 Aug 24 07:46:00.615022 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 340/673] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 24 07:46:00 2022] GET /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:46:01.626507 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-d1d496b1-347e-43fc-9ac3-57e36eb246cf tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:01.628676 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-d1d496b1-347e-43fc-9ac3-57e36eb246cf tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: b0139656-99b6-4568-8fc1-61ac16df46d1] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:01.635119 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d1d496b1-347e-43fc-9ac3-57e36eb246cf tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:01.635587 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d1d496b1-347e-43fc-9ac3-57e36eb246cf tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:01.636011 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d1d496b1-347e-43fc-9ac3-57e36eb246cf tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:01.636683 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d1d496b1-347e-43fc-9ac3-57e36eb246cf tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:01.637121 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d1d496b1-347e-43fc-9ac3-57e36eb246cf tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:01.637531 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d1d496b1-347e-43fc-9ac3-57e36eb246cf tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:01.666434 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-d1d496b1-347e-43fc-9ac3-57e36eb246cf tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043823 Aug 24 07:46:01.666987 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 334/674] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 24 07:46:01 2022] GET /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:46:02.519953 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-025d99ef-053a-4b19-917a-170a995d3ccb tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:02.520479 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-025d99ef-053a-4b19-917a-170a995d3ccb tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 6f20697e-980b-4345-addc-d4907757ff37] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:02.526883 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-025d99ef-053a-4b19-917a-170a995d3ccb tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:02.527367 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-025d99ef-053a-4b19-917a-170a995d3ccb tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:02.527802 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-025d99ef-053a-4b19-917a-170a995d3ccb tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:02.528493 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-025d99ef-053a-4b19-917a-170a995d3ccb tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:02.528946 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-025d99ef-053a-4b19-917a-170a995d3ccb tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:02.529369 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-025d99ef-053a-4b19-917a-170a995d3ccb tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:02.556162 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-025d99ef-053a-4b19-917a-170a995d3ccb tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 6f20697e-980b-4345-addc-d4907757ff37] Going to try to terminate instance {{(pid=127114) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 07:46:02.632336 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-025d99ef-053a-4b19-917a-170a995d3ccb tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37" status: 204 len: 0 microversion: 2.1 time: 0.115937 Aug 24 07:46:02.632915 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 341/675] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 24 07:46:02 2022] DELETE /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 07:46:02.641027 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-7bf6f837-51df-43cd-a984-871b4aac4889 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:02.641634 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-7bf6f837-51df-43cd-a984-871b4aac4889 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 6f20697e-980b-4345-addc-d4907757ff37] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:02.648250 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7bf6f837-51df-43cd-a984-871b4aac4889 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:02.648737 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7bf6f837-51df-43cd-a984-871b4aac4889 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:02.649167 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7bf6f837-51df-43cd-a984-871b4aac4889 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:02.650150 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7bf6f837-51df-43cd-a984-871b4aac4889 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:02.650730 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7bf6f837-51df-43cd-a984-871b4aac4889 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:02.651343 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7bf6f837-51df-43cd-a984-871b4aac4889 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:02.679650 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-2a778c3c-61ef-4895-aa1c-ed2feffa3438 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:02.682151 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-2a778c3c-61ef-4895-aa1c-ed2feffa3438 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: b0139656-99b6-4568-8fc1-61ac16df46d1] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:02.688165 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2a778c3c-61ef-4895-aa1c-ed2feffa3438 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:02.688643 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2a778c3c-61ef-4895-aa1c-ed2feffa3438 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:02.689072 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2a778c3c-61ef-4895-aa1c-ed2feffa3438 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:02.689756 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2a778c3c-61ef-4895-aa1c-ed2feffa3438 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:02.690202 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2a778c3c-61ef-4895-aa1c-ed2feffa3438 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:02.690618 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2a778c3c-61ef-4895-aa1c-ed2feffa3438 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:02.694409 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:02.722972 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-2a778c3c-61ef-4895-aa1c-ed2feffa3438 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047548 Aug 24 07:46:02.723524 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 342/676] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 24 07:46:02 2022] GET /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:46:02.787078 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-7bf6f837-51df-43cd-a984-871b4aac4889 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:02.794821 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-7bf6f837-51df-43cd-a984-871b4aac4889 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37" status: 200 len: 1578 microversion: 2.1 time: 0.157592 Aug 24 07:46:02.795381 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 335/677] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:46:02 2022] GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37 => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:46:03.735704 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-4db0cb48-1bc8-429f-8a89-b7d063086653 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:03.737797 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-4db0cb48-1bc8-429f-8a89-b7d063086653 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: b0139656-99b6-4568-8fc1-61ac16df46d1] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:03.744684 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4db0cb48-1bc8-429f-8a89-b7d063086653 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:03.745157 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4db0cb48-1bc8-429f-8a89-b7d063086653 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:03.745759 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4db0cb48-1bc8-429f-8a89-b7d063086653 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:03.746502 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4db0cb48-1bc8-429f-8a89-b7d063086653 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:03.746981 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4db0cb48-1bc8-429f-8a89-b7d063086653 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:03.747402 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4db0cb48-1bc8-429f-8a89-b7d063086653 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:03.776191 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-4db0cb48-1bc8-429f-8a89-b7d063086653 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045136 Aug 24 07:46:03.776738 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 343/678] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 24 07:46:03 2022] GET /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:46:03.816273 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-6a584737-fce9-49de-9741-2fcce960d44d tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:03.816880 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-6a584737-fce9-49de-9741-2fcce960d44d tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 6f20697e-980b-4345-addc-d4907757ff37] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:03.823336 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6a584737-fce9-49de-9741-2fcce960d44d tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:03.823812 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6a584737-fce9-49de-9741-2fcce960d44d tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:03.824244 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6a584737-fce9-49de-9741-2fcce960d44d tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:03.824930 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6a584737-fce9-49de-9741-2fcce960d44d tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:03.825377 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6a584737-fce9-49de-9741-2fcce960d44d tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:03.825827 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6a584737-fce9-49de-9741-2fcce960d44d tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:03.830254 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:03.961051 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-6a584737-fce9-49de-9741-2fcce960d44d tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:03.970328 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-6a584737-fce9-49de-9741-2fcce960d44d tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37" status: 200 len: 1578 microversion: 2.1 time: 0.157017 Aug 24 07:46:03.971177 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 336/679] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:46:03 2022] GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37 => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:46:04.788389 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-e8be6c8b-5252-47fe-b6c6-8a3944d28453 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:04.790487 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-e8be6c8b-5252-47fe-b6c6-8a3944d28453 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: b0139656-99b6-4568-8fc1-61ac16df46d1] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:04.796759 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e8be6c8b-5252-47fe-b6c6-8a3944d28453 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:04.797234 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e8be6c8b-5252-47fe-b6c6-8a3944d28453 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:04.797672 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e8be6c8b-5252-47fe-b6c6-8a3944d28453 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:04.798349 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e8be6c8b-5252-47fe-b6c6-8a3944d28453 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:04.799089 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e8be6c8b-5252-47fe-b6c6-8a3944d28453 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:04.799508 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e8be6c8b-5252-47fe-b6c6-8a3944d28453 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:04.830152 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-e8be6c8b-5252-47fe-b6c6-8a3944d28453 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045669 Aug 24 07:46:04.830730 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 344/680] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 24 07:46:04 2022] GET /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:46:04.991252 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-01d99868-ddf5-441c-a17e-687ec6fedc78 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:04.991874 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-01d99868-ddf5-441c-a17e-687ec6fedc78 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 6f20697e-980b-4345-addc-d4907757ff37] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:04.998998 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-01d99868-ddf5-441c-a17e-687ec6fedc78 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:04.999481 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-01d99868-ddf5-441c-a17e-687ec6fedc78 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:04.999914 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-01d99868-ddf5-441c-a17e-687ec6fedc78 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:05.001119 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-01d99868-ddf5-441c-a17e-687ec6fedc78 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:05.001574 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-01d99868-ddf5-441c-a17e-687ec6fedc78 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:05.001997 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-01d99868-ddf5-441c-a17e-687ec6fedc78 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:05.131368 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-01d99868-ddf5-441c-a17e-687ec6fedc78 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:05.139198 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-01d99868-ddf5-441c-a17e-687ec6fedc78 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37" status: 200 len: 1578 microversion: 2.1 time: 0.151752 Aug 24 07:46:05.140003 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 337/681] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:46:04 2022] GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37 => generated 1578 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:46:05.817380 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-001dec58-fdf8-4412-8005-eb22dd4c1182 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:05.819655 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-001dec58-fdf8-4412-8005-eb22dd4c1182 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 13cb624d-3028-4eaf-b4df-2983595448a0] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:05.826020 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-001dec58-fdf8-4412-8005-eb22dd4c1182 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:05.826567 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-001dec58-fdf8-4412-8005-eb22dd4c1182 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:05.827095 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-001dec58-fdf8-4412-8005-eb22dd4c1182 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:05.827846 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-001dec58-fdf8-4412-8005-eb22dd4c1182 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:05.828484 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-001dec58-fdf8-4412-8005-eb22dd4c1182 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:05.828931 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-001dec58-fdf8-4412-8005-eb22dd4c1182 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:05.842796 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-bc1af879-d765-4420-9c92-7ca9e14e7965 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:05.845449 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-bc1af879-d765-4420-9c92-7ca9e14e7965 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: b0139656-99b6-4568-8fc1-61ac16df46d1] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:05.856665 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bc1af879-d765-4420-9c92-7ca9e14e7965 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:05.857147 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bc1af879-d765-4420-9c92-7ca9e14e7965 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:05.857578 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bc1af879-d765-4420-9c92-7ca9e14e7965 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:05.858263 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bc1af879-d765-4420-9c92-7ca9e14e7965 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:05.858731 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bc1af879-d765-4420-9c92-7ca9e14e7965 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:05.859341 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bc1af879-d765-4420-9c92-7ca9e14e7965 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:05.869429 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-001dec58-fdf8-4412-8005-eb22dd4c1182 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.055885 Aug 24 07:46:05.870224 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 345/682] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 24 07:46:05 2022] GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0/os-volume_attachments => generated 371 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:46:05.889433 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-bc1af879-d765-4420-9c92-7ca9e14e7965 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050516 Aug 24 07:46:05.889995 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 338/683] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 24 07:46:05 2022] GET /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 07:46:05.952131 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-aa87ab4b-26e8-4ecf-9ac6-7cdc5f2bbc9e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:05.952617 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-aa87ab4b-26e8-4ecf-9ac6-7cdc5f2bbc9e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: b0139656-99b6-4568-8fc1-61ac16df46d1] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:05.958409 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-aa87ab4b-26e8-4ecf-9ac6-7cdc5f2bbc9e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:05.958919 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-aa87ab4b-26e8-4ecf-9ac6-7cdc5f2bbc9e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:05.959345 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-aa87ab4b-26e8-4ecf-9ac6-7cdc5f2bbc9e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:05.960021 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-aa87ab4b-26e8-4ecf-9ac6-7cdc5f2bbc9e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:05.960463 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-aa87ab4b-26e8-4ecf-9ac6-7cdc5f2bbc9e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:05.960874 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-aa87ab4b-26e8-4ecf-9ac6-7cdc5f2bbc9e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:05.985924 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-aa87ab4b-26e8-4ecf-9ac6-7cdc5f2bbc9e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: b0139656-99b6-4568-8fc1-61ac16df46d1] Going to try to terminate instance {{(pid=127114) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 07:46:06.005362 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-7cbb4894-cf12-412d-aa8c-65e904bdfba6 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:06.006210 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-7cbb4894-cf12-412d-aa8c-65e904bdfba6 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 13cb624d-3028-4eaf-b4df-2983595448a0] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:06.013085 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7cbb4894-cf12-412d-aa8c-65e904bdfba6 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:06.013560 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7cbb4894-cf12-412d-aa8c-65e904bdfba6 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:06.014202 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7cbb4894-cf12-412d-aa8c-65e904bdfba6 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:06.015119 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7cbb4894-cf12-412d-aa8c-65e904bdfba6 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:06.015926 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7cbb4894-cf12-412d-aa8c-65e904bdfba6 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:06.018388 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7cbb4894-cf12-412d-aa8c-65e904bdfba6 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:06.056641 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-7cbb4894-cf12-412d-aa8c-65e904bdfba6 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0/os-volume_attachments/ca503310-b75f-4a98-b50d-8ddd8d8dea51" status: 200 len: 194 microversion: 2.1 time: 0.054773 Aug 24 07:46:06.063765 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 339/684] 10.222.0.42 () {58 vars in 1413 bytes} [Wed Aug 24 07:46:06 2022] GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0/os-volume_attachments/ca503310-b75f-4a98-b50d-8ddd8d8dea51 => generated 194 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:46:06.069093 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [req-f4756a6e-003f-4ed0-8425-1300cf8bb8d7 req-0af19c6e-7532-4ba0-969d-af582de3535d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f20697e-980b-4345-addc-d4907757ff37", "name": "network-vif-deleted", "tag": "599f3399-205e-4f58-a04f-6a46a51e0c0e"}]} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:46:06.080545 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-f4756a6e-003f-4ed0-8425-1300cf8bb8d7 req-0af19c6e-7532-4ba0-969d-af582de3535d service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:06.081457 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-f4756a6e-003f-4ed0-8425-1300cf8bb8d7 req-0af19c6e-7532-4ba0-969d-af582de3535d service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:06.081885 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-f4756a6e-003f-4ed0-8425-1300cf8bb8d7 req-0af19c6e-7532-4ba0-969d-af582de3535d service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:06.083725 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-aa87ab4b-26e8-4ecf-9ac6-7cdc5f2bbc9e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1" status: 204 len: 0 microversion: 2.1 time: 0.135012 Aug 24 07:46:06.086490 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 346/685] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 24 07:46:05 2022] DELETE /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 07:46:06.092743 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-7e1f5cc1-a76c-4855-91f4-a2289716d982 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:06.093318 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-7e1f5cc1-a76c-4855-91f4-a2289716d982 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 13cb624d-3028-4eaf-b4df-2983595448a0] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:06.096821 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.compute.server_external_events [req-f4756a6e-003f-4ed0-8425-1300cf8bb8d7 req-0af19c6e-7532-4ba0-969d-af582de3535d service nova] Creating event network-vif-deleted:599f3399-205e-4f58-a04f-6a46a51e0c0e for instance 6f20697e-980b-4345-addc-d4907757ff37 on hv-cinder-85427 Aug 24 07:46:06.100802 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7e1f5cc1-a76c-4855-91f4-a2289716d982 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:06.101593 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7e1f5cc1-a76c-4855-91f4-a2289716d982 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:06.102227 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7e1f5cc1-a76c-4855-91f4-a2289716d982 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:06.103180 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7e1f5cc1-a76c-4855-91f4-a2289716d982 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:06.104187 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7e1f5cc1-a76c-4855-91f4-a2289716d982 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:06.104644 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7e1f5cc1-a76c-4855-91f4-a2289716d982 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:06.107157 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [req-f4756a6e-003f-4ed0-8425-1300cf8bb8d7 req-0af19c6e-7532-4ba0-969d-af582de3535d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041710 Aug 24 07:46:06.108138 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 340/686] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:46:06.116408 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-4a8af63b-d443-48fa-a8ee-45b368be5b05 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:06.117470 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-4a8af63b-d443-48fa-a8ee-45b368be5b05 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: b0139656-99b6-4568-8fc1-61ac16df46d1] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:06.124070 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4a8af63b-d443-48fa-a8ee-45b368be5b05 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:06.125039 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4a8af63b-d443-48fa-a8ee-45b368be5b05 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:06.126016 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4a8af63b-d443-48fa-a8ee-45b368be5b05 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:06.131172 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4a8af63b-d443-48fa-a8ee-45b368be5b05 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:06.131964 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4a8af63b-d443-48fa-a8ee-45b368be5b05 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:06.132471 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4a8af63b-d443-48fa-a8ee-45b368be5b05 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:06.217029 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.objects.instance [None req-7e1f5cc1-a76c-4855-91f4-a2289716d982 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lazy-loading 'services' on Instance uuid 13cb624d-3028-4eaf-b4df-2983595448a0 {{(pid=127114) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:46:06.286359 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-4a8af63b-d443-48fa-a8ee-45b368be5b05 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:06.296721 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-4a8af63b-d443-48fa-a8ee-45b368be5b05 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1" status: 200 len: 1681 microversion: 2.1 time: 0.186056 Aug 24 07:46:06.297312 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 341/687] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:46:06 2022] GET /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1 => generated 1681 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:46:06.302812 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-919f3a22-ff1f-46a3-8ce5-abb175e1fa2a tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:06.303406 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-919f3a22-ff1f-46a3-8ce5-abb175e1fa2a tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 6f20697e-980b-4345-addc-d4907757ff37] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:06.309439 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-919f3a22-ff1f-46a3-8ce5-abb175e1fa2a tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:06.309914 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-919f3a22-ff1f-46a3-8ce5-abb175e1fa2a tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:06.310350 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-919f3a22-ff1f-46a3-8ce5-abb175e1fa2a tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:06.311117 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-919f3a22-ff1f-46a3-8ce5-abb175e1fa2a tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:06.311568 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-919f3a22-ff1f-46a3-8ce5-abb175e1fa2a tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:06.311986 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-919f3a22-ff1f-46a3-8ce5-abb175e1fa2a tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:06.324136 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-7e1f5cc1-a76c-4855-91f4-a2289716d982 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "DELETE /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0/os-volume_attachments/ca503310-b75f-4a98-b50d-8ddd8d8dea51" status: 202 len: 0 microversion: 2.1 time: 0.236115 Aug 24 07:46:06.325062 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 347/688] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Aug 24 07:46:06 2022] DELETE /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0/os-volume_attachments/ca503310-b75f-4a98-b50d-8ddd8d8dea51 => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 07:46:06.384751 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-919f3a22-ff1f-46a3-8ce5-abb175e1fa2a tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:06.393010 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-919f3a22-ff1f-46a3-8ce5-abb175e1fa2a tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37" status: 200 len: 1225 microversion: 2.1 time: 0.094277 Aug 24 07:46:06.393556 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 342/689] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:46:06 2022] GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:46:07.318906 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-5581a9da-0012-4307-aee1-fc92ee4f3327 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:07.319602 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-5581a9da-0012-4307-aee1-fc92ee4f3327 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: b0139656-99b6-4568-8fc1-61ac16df46d1] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:07.321589 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:07.327033 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5581a9da-0012-4307-aee1-fc92ee4f3327 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:07.327512 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5581a9da-0012-4307-aee1-fc92ee4f3327 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:07.327946 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5581a9da-0012-4307-aee1-fc92ee4f3327 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:07.329227 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5581a9da-0012-4307-aee1-fc92ee4f3327 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:07.329680 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5581a9da-0012-4307-aee1-fc92ee4f3327 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:07.330102 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5581a9da-0012-4307-aee1-fc92ee4f3327 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:07.414249 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-be715a57-bb88-45c4-a976-9e2ce66a15e8 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:07.415051 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-be715a57-bb88-45c4-a976-9e2ce66a15e8 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 6f20697e-980b-4345-addc-d4907757ff37] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:07.421510 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-be715a57-bb88-45c4-a976-9e2ce66a15e8 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:07.421996 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-be715a57-bb88-45c4-a976-9e2ce66a15e8 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:07.422461 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-be715a57-bb88-45c4-a976-9e2ce66a15e8 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:07.423242 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-be715a57-bb88-45c4-a976-9e2ce66a15e8 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:07.424167 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-be715a57-bb88-45c4-a976-9e2ce66a15e8 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:07.424592 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-be715a57-bb88-45c4-a976-9e2ce66a15e8 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:07.481315 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-5581a9da-0012-4307-aee1-fc92ee4f3327 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:07.489300 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-5581a9da-0012-4307-aee1-fc92ee4f3327 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1" status: 200 len: 1681 microversion: 2.1 time: 0.175063 Aug 24 07:46:07.489863 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 348/690] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:46:07 2022] GET /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1 => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:46:07.494210 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-be715a57-bb88-45c4-a976-9e2ce66a15e8 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:07.502582 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-be715a57-bb88-45c4-a976-9e2ce66a15e8 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37" status: 200 len: 1225 microversion: 2.1 time: 0.093050 Aug 24 07:46:07.503312 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 343/691] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:46:07 2022] GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:46:08.510201 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-5b5f6027-cadc-4e6b-8674-8e3f55b0ccce tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:08.510833 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-5b5f6027-cadc-4e6b-8674-8e3f55b0ccce tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: b0139656-99b6-4568-8fc1-61ac16df46d1] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:08.518175 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5b5f6027-cadc-4e6b-8674-8e3f55b0ccce tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:08.518687 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5b5f6027-cadc-4e6b-8674-8e3f55b0ccce tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:08.519604 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5b5f6027-cadc-4e6b-8674-8e3f55b0ccce tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:08.520489 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5b5f6027-cadc-4e6b-8674-8e3f55b0ccce tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:08.520999 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5b5f6027-cadc-4e6b-8674-8e3f55b0ccce tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:08.521504 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5b5f6027-cadc-4e6b-8674-8e3f55b0ccce tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:08.524544 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-44c8293f-5a4f-4468-b928-25444d3029b6 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:08.525695 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-44c8293f-5a4f-4468-b928-25444d3029b6 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 6f20697e-980b-4345-addc-d4907757ff37] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:08.532938 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-44c8293f-5a4f-4468-b928-25444d3029b6 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:08.533818 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-44c8293f-5a4f-4468-b928-25444d3029b6 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:08.535138 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-44c8293f-5a4f-4468-b928-25444d3029b6 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:08.536042 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-44c8293f-5a4f-4468-b928-25444d3029b6 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:08.537432 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-44c8293f-5a4f-4468-b928-25444d3029b6 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:08.538047 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-44c8293f-5a4f-4468-b928-25444d3029b6 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:08.553126 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.wsgi [None req-44c8293f-5a4f-4468-b928-25444d3029b6 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] HTTP exception thrown: Instance 6f20697e-980b-4345-addc-d4907757ff37 could not be found. Aug 24 07:46:08.555902 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-44c8293f-5a4f-4468-b928-25444d3029b6 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Request method failure captured: Aug 24 07:46:08.555902 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: request: GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37 HTTP/1.1 Aug 24 07:46:08.555902 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept: application/json Aug 24 07:46:08.555902 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept-Encoding: identity Aug 24 07:46:08.555902 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Connection: close Aug 24 07:46:08.555902 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Length: 0 Aug 24 07:46:08.555902 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Type: application/json Aug 24 07:46:08.555902 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Host: 10.222.0.42 Aug 24 07:46:08.555902 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Openstack-System-Scope: None Aug 24 07:46:08.555902 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: User-Agent: python-urllib3/1.26.11 Aug 24 07:46:08.555902 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Auth-Token: gAAAAABjBdZqcBk483UUSWesWFTPKlAwMwjT5XV8JOe2-n-FOpuawHh1Z4gwimRsUqNiPmk2or-Qy4uvNRjWV6_WaL47uuFhZQsksiDoj5_mzRjIlg1vWHdzQ7HJAjC6-N06Kjn0WAOdyYuhZJQF8Rdz-zyv3MZxviUSVS6s6UQegvYiOsP_H4k Aug 24 07:46:08.555902 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Id: None Aug 24 07:46:08.555902 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Name: None Aug 24 07:46:08.555902 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Identity-Status: Confirmed Aug 24 07:46:08.555902 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Is-Admin-Project: True Aug 24 07:46:08.555902 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Id: default Aug 24 07:46:08.555902 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Name: Default Aug 24 07:46:08.555902 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Id: e97fd16d61ef4d5ebc5f435ae8a18561 Aug 24 07:46:08.555902 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Name: tempest-TestVolumeBootPattern-1549272169 Aug 24 07:46:08.555902 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Role: reader,member Aug 24 07:46:08.555902 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Roles: reader,member Aug 24 07:46:08.557469 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e97fd16d61ef4d5ebc5f435ae8a18561"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e97fd16d61ef4d5ebc5f435ae8a18561", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e97fd16d61ef4d5ebc5f435ae8a18561"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e97fd16d61ef4d5ebc5f435ae8a18561"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:46:08.557469 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant: tempest-TestVolumeBootPattern-1549272169 Aug 24 07:46:08.557469 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Id: e97fd16d61ef4d5ebc5f435ae8a18561 Aug 24 07:46:08.557469 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Name: tempest-TestVolumeBootPattern-1549272169 Aug 24 07:46:08.557469 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User: tempest-TestVolumeBootPattern-1549272169-project Aug 24 07:46:08.557469 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Id: default Aug 24 07:46:08.557469 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Name: Default Aug 24 07:46:08.557469 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Id: 760115e8fb554582a016445f9aadc00c Aug 24 07:46:08.557469 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Name: tempest-TestVolumeBootPattern-1549272169-project Aug 24 07:46:08.557469 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: method: > Aug 24 07:46:08.557469 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: exception: Instance 6f20697e-980b-4345-addc-d4907757ff37 could not be found. Aug 24 07:46:08.557469 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: action_args: {'id': '6f20697e-980b-4345-addc-d4907757ff37'} Aug 24 07:46:08.558288 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:46:08.558288 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:46:08.558288 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:46:08.558288 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:46:08.558288 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:46:08.558288 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:46:08.558288 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:46:08.558288 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:46:08.558288 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:46:08.558288 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:46:08.558288 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f20697e-980b-4345-addc-d4907757ff37 could not be found. Aug 24 07:46:08.558288 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:46:08.558288 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:46:08.558288 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:46:08.558288 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:46:08.558288 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:46:08.558288 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:46:08.558288 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:46:08.558288 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:46:08.558288 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:46:08.559531 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:46:08.559531 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 07:46:08.559531 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 07:46:08.559531 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:46:08.559531 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:46:08.559531 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:46:08.559531 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:46:08.559531 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f20697e-980b-4345-addc-d4907757ff37 could not be found. Aug 24 07:46:08.559531 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:46:08.559531 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:46:08.559531 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:46:08.559531 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:46:08.559531 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:46:08.559531 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:46:08.559531 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:46:08.559531 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:46:08.559531 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f20697e-980b-4345-addc-d4907757ff37 could not be found. Aug 24 07:46:08.559531 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:46:08.564107 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-44c8293f-5a4f-4468-b928-25444d3029b6 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Returning 404 to user: Instance 6f20697e-980b-4345-addc-d4907757ff37 could not be found. {{(pid=127113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:46:08.566223 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-44c8293f-5a4f-4468-b928-25444d3029b6 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37" status: 404 len: 111 microversion: 2.1 time: 0.044979 Aug 24 07:46:08.575175 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 344/692] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:46:08 2022] GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 07:46:08.684848 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-fc5fc4fd-c8f5-45fd-8389-e093817244fa tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1133715018", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2141614004", "security_groups": [{"name": "tempest-secgroup-smoke-2065229898"}], "block_device_mapping_v2": [{"uuid": "29f7517c-1620-4ae5-9ef5-4293686c8688", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6249c133-fde8-4248-b989-66dfa30799de"}]}} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:46:08.695357 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:08.784723 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-5b5f6027-cadc-4e6b-8674-8e3f55b0ccce tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:08.792868 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-5b5f6027-cadc-4e6b-8674-8e3f55b0ccce tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1" status: 200 len: 1681 microversion: 2.1 time: 0.286239 Aug 24 07:46:08.793540 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 349/693] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:46:08 2022] GET /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1 => generated 1681 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:46:08.804039 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.network.neutron [None req-fc5fc4fd-c8f5-45fd-8389-e093817244fa tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] validate_networks() for [('6249c133-fde8-4248-b989-66dfa30799de', None, None, None, None, None)] {{(pid=127113) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 07:46:09.184358 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.virt.hardware [None req-fc5fc4fd-c8f5-45fd-8389-e093817244fa tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Flavor limits 0:0:0 {{(pid=127113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 07:46:09.184781 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.virt.hardware [None req-fc5fc4fd-c8f5-45fd-8389-e093817244fa tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Image limits 0:0:0 {{(pid=127113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 07:46:09.185251 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.virt.hardware [None req-fc5fc4fd-c8f5-45fd-8389-e093817244fa tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Flavor pref 0:0:0 {{(pid=127113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 07:46:09.185658 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.virt.hardware [None req-fc5fc4fd-c8f5-45fd-8389-e093817244fa tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Image pref 0:0:0 {{(pid=127113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 07:46:09.186407 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.virt.hardware [None req-fc5fc4fd-c8f5-45fd-8389-e093817244fa tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 07:46:09.195490 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-fc5fc4fd-c8f5-45fd-8389-e093817244fa tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:09.195990 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-fc5fc4fd-c8f5-45fd-8389-e093817244fa tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:09.196418 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-fc5fc4fd-c8f5-45fd-8389-e093817244fa tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:09.197135 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-fc5fc4fd-c8f5-45fd-8389-e093817244fa tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:09.197636 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-fc5fc4fd-c8f5-45fd-8389-e093817244fa tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:09.198061 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-fc5fc4fd-c8f5-45fd-8389-e093817244fa tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:09.215130 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.quota [None req-fc5fc4fd-c8f5-45fd-8389-e093817244fa tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Getting quotas for project e97fd16d61ef4d5ebc5f435ae8a18561. Resources: {'cores', 'ram', 'instances'} {{(pid=127113) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:46:09.219101 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.quota [None req-fc5fc4fd-c8f5-45fd-8389-e093817244fa tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Getting quotas for user 760115e8fb554582a016445f9aadc00c and project e97fd16d61ef4d5ebc5f435ae8a18561. Resources: {'cores', 'ram', 'instances'} {{(pid=127113) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:46:09.283455 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-fc5fc4fd-c8f5-45fd-8389-e093817244fa tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Going to run 1 instances... {{(pid=127113) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 07:46:09.285585 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-fc5fc4fd-c8f5-45fd-8389-e093817244fa tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 0e77f06a-967d-4e17-9254-dd0237ec8d0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='29f7517c-1620-4ae5-9ef5-4293686c8688',volume_size=None,volume_type=None)] {{(pid=127113) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 07:46:09.421354 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-fc5fc4fd-c8f5-45fd-8389-e093817244fa tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.740336 Aug 24 07:46:09.422193 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 345/694] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 24 07:46:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 07:46:09.433254 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-14509f65-5190-4d80-a0fe-75aaa52feba6 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:09.433791 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-14509f65-5190-4d80-a0fe-75aaa52feba6 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 0e77f06a-967d-4e17-9254-dd0237ec8d0e] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:09.493109 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-14509f65-5190-4d80-a0fe-75aaa52feba6 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:09.501519 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-14509f65-5190-4d80-a0fe-75aaa52feba6 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/0e77f06a-967d-4e17-9254-dd0237ec8d0e" status: 200 len: 1095 microversion: 2.1 time: 0.072193 Aug 24 07:46:09.502094 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 350/695] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:46:09 2022] GET /compute/v2.1/servers/0e77f06a-967d-4e17-9254-dd0237ec8d0e => generated 1095 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:46:09.575342 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [req-86bb35eb-0592-4467-966b-340585d91e17 req-90e8f41d-d7bb-4bb7-a8de-5477a15cfd2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0139656-99b6-4568-8fc1-61ac16df46d1", "name": "network-vif-deleted", "tag": "b72da8e1-28c5-4441-874f-6a0d6314ddd5"}]} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:46:09.581942 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-f2db47eb-61c0-4ab4-b04f-2aff6a2de9c1 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:09.582451 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-f2db47eb-61c0-4ab4-b04f-2aff6a2de9c1 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 13cb624d-3028-4eaf-b4df-2983595448a0] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:09.596469 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f2db47eb-61c0-4ab4-b04f-2aff6a2de9c1 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:09.598547 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f2db47eb-61c0-4ab4-b04f-2aff6a2de9c1 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:09.599860 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-86bb35eb-0592-4467-966b-340585d91e17 req-90e8f41d-d7bb-4bb7-a8de-5477a15cfd2c service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:09.600336 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-86bb35eb-0592-4467-966b-340585d91e17 req-90e8f41d-d7bb-4bb7-a8de-5477a15cfd2c service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:09.600694 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f2db47eb-61c0-4ab4-b04f-2aff6a2de9c1 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:09.600837 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-86bb35eb-0592-4467-966b-340585d91e17 req-90e8f41d-d7bb-4bb7-a8de-5477a15cfd2c service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:09.601706 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f2db47eb-61c0-4ab4-b04f-2aff6a2de9c1 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:09.605429 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f2db47eb-61c0-4ab4-b04f-2aff6a2de9c1 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:09.605766 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f2db47eb-61c0-4ab4-b04f-2aff6a2de9c1 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:09.621703 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.compute.server_external_events [req-86bb35eb-0592-4467-966b-340585d91e17 req-90e8f41d-d7bb-4bb7-a8de-5477a15cfd2c service nova] Creating event network-vif-deleted:b72da8e1-28c5-4441-874f-6a0d6314ddd5 for instance b0139656-99b6-4568-8fc1-61ac16df46d1 on hv-cinder-85427 Aug 24 07:46:09.628340 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [req-86bb35eb-0592-4467-966b-340585d91e17 req-90e8f41d-d7bb-4bb7-a8de-5477a15cfd2c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056792 Aug 24 07:46:09.630485 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 346/696] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:46:09.683358 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-f2db47eb-61c0-4ab4-b04f-2aff6a2de9c1 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0/os-volume_attachments/b06032f8-8e53-4dc2-8cee-6154a2c0fac7" status: 200 len: 194 microversion: 2.1 time: 0.105897 Aug 24 07:46:09.684468 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 351/697] 10.222.0.42 () {58 vars in 1413 bytes} [Wed Aug 24 07:46:09 2022] GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0/os-volume_attachments/b06032f8-8e53-4dc2-8cee-6154a2c0fac7 => generated 194 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:46:09.705625 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-009cdf8b-e1e8-48ce-a433-8d442be26bf6 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:09.706723 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-009cdf8b-e1e8-48ce-a433-8d442be26bf6 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 13cb624d-3028-4eaf-b4df-2983595448a0] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:09.715278 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-009cdf8b-e1e8-48ce-a433-8d442be26bf6 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:09.716056 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-009cdf8b-e1e8-48ce-a433-8d442be26bf6 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:09.716665 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-009cdf8b-e1e8-48ce-a433-8d442be26bf6 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:09.718182 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-009cdf8b-e1e8-48ce-a433-8d442be26bf6 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:09.719148 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-009cdf8b-e1e8-48ce-a433-8d442be26bf6 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:09.719857 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-009cdf8b-e1e8-48ce-a433-8d442be26bf6 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:09.818973 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-b3109aa2-54fe-4f6f-9772-8697e4c6eeae tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:09.819895 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-b3109aa2-54fe-4f6f-9772-8697e4c6eeae tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: b0139656-99b6-4568-8fc1-61ac16df46d1] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:09.833824 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b3109aa2-54fe-4f6f-9772-8697e4c6eeae tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:09.834261 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b3109aa2-54fe-4f6f-9772-8697e4c6eeae tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:09.835492 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b3109aa2-54fe-4f6f-9772-8697e4c6eeae tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:09.836760 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b3109aa2-54fe-4f6f-9772-8697e4c6eeae tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:09.837457 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b3109aa2-54fe-4f6f-9772-8697e4c6eeae tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:09.838096 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b3109aa2-54fe-4f6f-9772-8697e4c6eeae tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:09.851276 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.objects.instance [None req-009cdf8b-e1e8-48ce-a433-8d442be26bf6 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lazy-loading 'services' on Instance uuid 13cb624d-3028-4eaf-b4df-2983595448a0 {{(pid=127113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:46:09.889753 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b3109aa2-54fe-4f6f-9772-8697e4c6eeae tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:09.890327 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b3109aa2-54fe-4f6f-9772-8697e4c6eeae tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:09.890788 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b3109aa2-54fe-4f6f-9772-8697e4c6eeae tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:09.891555 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.objects.instance [None req-b3109aa2-54fe-4f6f-9772-8697e4c6eeae tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lazy-loading 'fault' on Instance uuid b0139656-99b6-4568-8fc1-61ac16df46d1 {{(pid=127114) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:46:09.942534 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-b3109aa2-54fe-4f6f-9772-8697e4c6eeae tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:09.953706 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-b3109aa2-54fe-4f6f-9772-8697e4c6eeae tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1" status: 200 len: 1332 microversion: 2.1 time: 0.142378 Aug 24 07:46:09.954287 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 352/698] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:46:09 2022] GET /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1 => generated 1332 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:46:09.955979 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-009cdf8b-e1e8-48ce-a433-8d442be26bf6 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "DELETE /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0/os-volume_attachments/b06032f8-8e53-4dc2-8cee-6154a2c0fac7" status: 202 len: 0 microversion: 2.1 time: 0.263009 Aug 24 07:46:09.958774 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 347/699] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Aug 24 07:46:09 2022] DELETE /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0/os-volume_attachments/b06032f8-8e53-4dc2-8cee-6154a2c0fac7 => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 07:46:10.523477 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-12bc0d7d-b025-4056-bc5d-2cd94383f027 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:10.524301 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-12bc0d7d-b025-4056-bc5d-2cd94383f027 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 0e77f06a-967d-4e17-9254-dd0237ec8d0e] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:10.533339 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-12bc0d7d-b025-4056-bc5d-2cd94383f027 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:10.533825 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-12bc0d7d-b025-4056-bc5d-2cd94383f027 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:10.537341 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-12bc0d7d-b025-4056-bc5d-2cd94383f027 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:10.538313 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-12bc0d7d-b025-4056-bc5d-2cd94383f027 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:10.538952 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-12bc0d7d-b025-4056-bc5d-2cd94383f027 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:10.539242 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-12bc0d7d-b025-4056-bc5d-2cd94383f027 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:10.608929 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-12bc0d7d-b025-4056-bc5d-2cd94383f027 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:10.617442 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-12bc0d7d-b025-4056-bc5d-2cd94383f027 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/0e77f06a-967d-4e17-9254-dd0237ec8d0e" status: 200 len: 1193 microversion: 2.1 time: 0.098150 Aug 24 07:46:10.618017 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 353/700] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:46:10 2022] GET /compute/v2.1/servers/0e77f06a-967d-4e17-9254-dd0237ec8d0e => generated 1193 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:46:10.975498 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-4b28c335-1215-4975-9c07-022dee4723d7 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:10.976205 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-4b28c335-1215-4975-9c07-022dee4723d7 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: b0139656-99b6-4568-8fc1-61ac16df46d1] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:10.983004 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4b28c335-1215-4975-9c07-022dee4723d7 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:10.983492 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4b28c335-1215-4975-9c07-022dee4723d7 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:10.983929 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4b28c335-1215-4975-9c07-022dee4723d7 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:10.984626 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4b28c335-1215-4975-9c07-022dee4723d7 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:10.985083 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4b28c335-1215-4975-9c07-022dee4723d7 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:10.985503 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4b28c335-1215-4975-9c07-022dee4723d7 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:10.999379 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.wsgi [None req-4b28c335-1215-4975-9c07-022dee4723d7 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] HTTP exception thrown: Instance b0139656-99b6-4568-8fc1-61ac16df46d1 could not be found. Aug 24 07:46:11.001552 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-4b28c335-1215-4975-9c07-022dee4723d7 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Request method failure captured: Aug 24 07:46:11.001552 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: request: GET /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1 HTTP/1.1 Aug 24 07:46:11.001552 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept: application/json Aug 24 07:46:11.001552 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept-Encoding: identity Aug 24 07:46:11.001552 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Connection: close Aug 24 07:46:11.001552 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Length: 0 Aug 24 07:46:11.001552 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Type: application/json Aug 24 07:46:11.001552 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Host: 10.222.0.42 Aug 24 07:46:11.001552 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Openstack-System-Scope: None Aug 24 07:46:11.001552 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: User-Agent: python-urllib3/1.26.11 Aug 24 07:46:11.001552 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Auth-Token: gAAAAABjBdYobzFKkpFZErKGYQQ6C-XEh7i9OW8ojTbqxPVr74lckpRiFaze-efBQslsaQSX_M9uiYyghTqG7Fg_jrM-qOMOyzErIrVcNm0xIs9NgJg7VzKqJCSA-yXxsyHfCdfoLwTQ2cusI7TmXO58zoZh7YF2Ykkf3m7e8LiRBBQiO6NdfF4 Aug 24 07:46:11.001552 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Id: None Aug 24 07:46:11.001552 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Name: None Aug 24 07:46:11.001552 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Identity-Status: Confirmed Aug 24 07:46:11.001552 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Is-Admin-Project: True Aug 24 07:46:11.001552 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Id: default Aug 24 07:46:11.001552 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Name: Default Aug 24 07:46:11.001552 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Id: af5acb73124c485aa87e60b4e5d4f6d4 Aug 24 07:46:11.001552 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Name: tempest-AttachVolumeNegativeTest-1077633228 Aug 24 07:46:11.001552 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Role: reader,member Aug 24 07:46:11.001552 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Roles: reader,member Aug 24 07:46:11.002872 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af5acb73124c485aa87e60b4e5d4f6d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_af5acb73124c485aa87e60b4e5d4f6d4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af5acb73124c485aa87e60b4e5d4f6d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/af5acb73124c485aa87e60b4e5d4f6d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:46:11.002872 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant: tempest-AttachVolumeNegativeTest-1077633228 Aug 24 07:46:11.002872 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Id: af5acb73124c485aa87e60b4e5d4f6d4 Aug 24 07:46:11.002872 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1077633228 Aug 24 07:46:11.002872 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User: tempest-AttachVolumeNegativeTest-1077633228-project Aug 24 07:46:11.002872 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Id: default Aug 24 07:46:11.002872 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Name: Default Aug 24 07:46:11.002872 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Id: f594c9344b2c472ba33ceef87ec88a0b Aug 24 07:46:11.002872 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Name: tempest-AttachVolumeNegativeTest-1077633228-project Aug 24 07:46:11.002872 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: method: > Aug 24 07:46:11.002872 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: exception: Instance b0139656-99b6-4568-8fc1-61ac16df46d1 could not be found. Aug 24 07:46:11.002872 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: action_args: {'id': 'b0139656-99b6-4568-8fc1-61ac16df46d1'} Aug 24 07:46:11.003748 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:46:11.003748 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:46:11.003748 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:46:11.003748 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:46:11.003748 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:46:11.003748 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:46:11.003748 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:46:11.003748 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:46:11.003748 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:46:11.003748 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:46:11.003748 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0139656-99b6-4568-8fc1-61ac16df46d1 could not be found. Aug 24 07:46:11.003748 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:46:11.003748 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:46:11.003748 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:46:11.003748 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:46:11.003748 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:46:11.003748 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:46:11.003748 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:46:11.003748 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:46:11.003748 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:46:11.005225 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:46:11.005225 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 07:46:11.005225 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 07:46:11.005225 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:46:11.005225 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:46:11.005225 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:46:11.005225 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:46:11.005225 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0139656-99b6-4568-8fc1-61ac16df46d1 could not be found. Aug 24 07:46:11.005225 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:46:11.005225 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:46:11.005225 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:46:11.005225 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:46:11.005225 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:46:11.005225 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:46:11.005225 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:46:11.005225 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:46:11.005225 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0139656-99b6-4568-8fc1-61ac16df46d1 could not be found. Aug 24 07:46:11.005225 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:46:11.006655 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-4b28c335-1215-4975-9c07-022dee4723d7 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Returning 404 to user: Instance b0139656-99b6-4568-8fc1-61ac16df46d1 could not be found. {{(pid=127113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:46:11.006655 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-4b28c335-1215-4975-9c07-022dee4723d7 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1" status: 404 len: 111 microversion: 2.1 time: 0.031889 Aug 24 07:46:11.006655 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 348/701] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:46:10 2022] GET /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:46:11.012541 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-1b86064b-e4fb-4100-9f05-e0008a61c126 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '.version_select at 0x7faf687cc280>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:11.033752 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-1b86064b-e4fb-4100-9f05-e0008a61c126 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1894608456" status: 202 len: 0 microversion: 2.1 time: 0.025244 Aug 24 07:46:11.034572 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 354/702] 10.222.0.42 () {58 vars in 1221 bytes} [Wed Aug 24 07:46:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1894608456 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 07:46:11.162252 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-2f205ec8-a645-47a2-853d-eff73db5f694 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:11.164700 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-2f205ec8-a645-47a2-853d-eff73db5f694 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 13cb624d-3028-4eaf-b4df-2983595448a0] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:11.171067 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2f205ec8-a645-47a2-853d-eff73db5f694 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:11.171676 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2f205ec8-a645-47a2-853d-eff73db5f694 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:11.172270 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2f205ec8-a645-47a2-853d-eff73db5f694 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:11.173462 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2f205ec8-a645-47a2-853d-eff73db5f694 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:11.174031 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2f205ec8-a645-47a2-853d-eff73db5f694 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:11.174558 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2f205ec8-a645-47a2-853d-eff73db5f694 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:11.209864 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-2f205ec8-a645-47a2-853d-eff73db5f694 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051897 Aug 24 07:46:11.210677 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 349/703] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 24 07:46:11 2022] GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 07:46:11.333616 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-4a26abbe-1708-4113-9145-938827d11551 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:11.335888 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-4a26abbe-1708-4113-9145-938827d11551 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 13cb624d-3028-4eaf-b4df-2983595448a0] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:11.343058 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4a26abbe-1708-4113-9145-938827d11551 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:11.343692 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4a26abbe-1708-4113-9145-938827d11551 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:11.344404 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4a26abbe-1708-4113-9145-938827d11551 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:11.345225 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4a26abbe-1708-4113-9145-938827d11551 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:11.345777 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4a26abbe-1708-4113-9145-938827d11551 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:11.346306 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4a26abbe-1708-4113-9145-938827d11551 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:11.381650 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-4a26abbe-1708-4113-9145-938827d11551 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051907 Aug 24 07:46:11.382336 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 355/704] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 24 07:46:11 2022] GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 07:46:11.449969 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-2a36aeef-6257-4ff6-bf06-4de15de2bbdc tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:11.451281 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-2a36aeef-6257-4ff6-bf06-4de15de2bbdc tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 13cb624d-3028-4eaf-b4df-2983595448a0] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:11.457695 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2a36aeef-6257-4ff6-bf06-4de15de2bbdc tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:11.458985 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2a36aeef-6257-4ff6-bf06-4de15de2bbdc tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:11.458985 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2a36aeef-6257-4ff6-bf06-4de15de2bbdc tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:11.459884 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2a36aeef-6257-4ff6-bf06-4de15de2bbdc tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:11.460425 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2a36aeef-6257-4ff6-bf06-4de15de2bbdc tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:11.461008 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2a36aeef-6257-4ff6-bf06-4de15de2bbdc tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:11.488367 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-2a36aeef-6257-4ff6-bf06-4de15de2bbdc tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 13cb624d-3028-4eaf-b4df-2983595448a0] Going to try to terminate instance {{(pid=127113) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 07:46:11.611695 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-2a36aeef-6257-4ff6-bf06-4de15de2bbdc tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "DELETE /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0" status: 204 len: 0 microversion: 2.1 time: 0.165200 Aug 24 07:46:11.612326 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 350/705] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 24 07:46:11 2022] DELETE /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 07:46:11.620881 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-c28e87c1-7463-4bff-af31-42f4c8f7ee5b tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:11.621426 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-c28e87c1-7463-4bff-af31-42f4c8f7ee5b tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 13cb624d-3028-4eaf-b4df-2983595448a0] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:11.629049 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c28e87c1-7463-4bff-af31-42f4c8f7ee5b tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:11.629545 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c28e87c1-7463-4bff-af31-42f4c8f7ee5b tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:11.630620 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c28e87c1-7463-4bff-af31-42f4c8f7ee5b tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:11.631558 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c28e87c1-7463-4bff-af31-42f4c8f7ee5b tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:11.633474 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c28e87c1-7463-4bff-af31-42f4c8f7ee5b tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:11.633474 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c28e87c1-7463-4bff-af31-42f4c8f7ee5b tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:11.642744 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-572015a7-08a1-45e1-a15a-57d386c8acf8 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:11.643518 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-572015a7-08a1-45e1-a15a-57d386c8acf8 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 0e77f06a-967d-4e17-9254-dd0237ec8d0e] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:11.651962 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-572015a7-08a1-45e1-a15a-57d386c8acf8 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:11.652598 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-572015a7-08a1-45e1-a15a-57d386c8acf8 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:11.653039 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-572015a7-08a1-45e1-a15a-57d386c8acf8 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:11.654610 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-572015a7-08a1-45e1-a15a-57d386c8acf8 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:11.655093 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-572015a7-08a1-45e1-a15a-57d386c8acf8 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:11.655742 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-572015a7-08a1-45e1-a15a-57d386c8acf8 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:11.876738 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-c28e87c1-7463-4bff-af31-42f4c8f7ee5b tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:11.887165 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-c28e87c1-7463-4bff-af31-42f4c8f7ee5b tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0" status: 200 len: 1674 microversion: 2.1 time: 0.270431 Aug 24 07:46:11.888295 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 356/706] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:46:11 2022] GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0 => generated 1674 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:46:11.895306 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-05be0811-9702-4a95-b78d-c39c8f749eae tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Action: 'create', calling method: .version_select at 0x7faf684bf4c0>, body: {"keypair": {"name": "tempest-keypair-1467060365", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANO8Ou2udoIjZCi3L5Ho1GeY4XgDLJQSwzRjdimj7iFj4vNE2A1cDyLWYaXq+NxZkC7P0w6LISQWeznfI3ib1oKKigXCKG8pR8zW7K3+rWJDruebMMDeN/81/Vbu3Md0A=="}} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:46:11.906571 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-572015a7-08a1-45e1-a15a-57d386c8acf8 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:11.913121 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.quota [None req-05be0811-9702-4a95-b78d-c39c8f749eae tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Getting quotas for project af5acb73124c485aa87e60b4e5d4f6d4. Resources: {'key_pairs'} {{(pid=127114) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:46:11.917820 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.quota [None req-05be0811-9702-4a95-b78d-c39c8f749eae tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Getting quotas for user f594c9344b2c472ba33ceef87ec88a0b and project af5acb73124c485aa87e60b4e5d4f6d4. Resources: {'key_pairs'} {{(pid=127114) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:46:11.919449 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-572015a7-08a1-45e1-a15a-57d386c8acf8 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/0e77f06a-967d-4e17-9254-dd0237ec8d0e" status: 200 len: 1267 microversion: 2.1 time: 0.284109 Aug 24 07:46:11.920061 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 351/707] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:46:11 2022] GET /compute/v2.1/servers/0e77f06a-967d-4e17-9254-dd0237ec8d0e => generated 1267 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:46:11.950400 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-05be0811-9702-4a95-b78d-c39c8f749eae tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.060526 Aug 24 07:46:11.951062 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 357/708] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Aug 24 07:46:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:46:12.911968 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-b634e144-cdcf-488e-ab84-fd275eeec6fa tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:12.912595 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-b634e144-cdcf-488e-ab84-fd275eeec6fa tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 13cb624d-3028-4eaf-b4df-2983595448a0] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:12.918896 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b634e144-cdcf-488e-ab84-fd275eeec6fa tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:12.919377 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b634e144-cdcf-488e-ab84-fd275eeec6fa tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:12.919807 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b634e144-cdcf-488e-ab84-fd275eeec6fa tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:12.920488 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b634e144-cdcf-488e-ab84-fd275eeec6fa tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:12.920936 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b634e144-cdcf-488e-ab84-fd275eeec6fa tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:12.921356 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b634e144-cdcf-488e-ab84-fd275eeec6fa tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:12.942866 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-e545c250-31a6-48bd-9246-4247de108446 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:12.944379 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-e545c250-31a6-48bd-9246-4247de108446 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 0e77f06a-967d-4e17-9254-dd0237ec8d0e] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:12.950445 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e545c250-31a6-48bd-9246-4247de108446 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:12.950954 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e545c250-31a6-48bd-9246-4247de108446 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:12.951569 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e545c250-31a6-48bd-9246-4247de108446 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:12.952267 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e545c250-31a6-48bd-9246-4247de108446 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:12.952710 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e545c250-31a6-48bd-9246-4247de108446 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:12.953356 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e545c250-31a6-48bd-9246-4247de108446 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:13.053649 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-b634e144-cdcf-488e-ab84-fd275eeec6fa tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:13.061584 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-b634e144-cdcf-488e-ab84-fd275eeec6fa tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0" status: 200 len: 1674 microversion: 2.1 time: 0.153464 Aug 24 07:46:13.062144 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 352/709] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:46:12 2022] GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:46:13.227790 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-e545c250-31a6-48bd-9246-4247de108446 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:13.237344 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-e545c250-31a6-48bd-9246-4247de108446 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/0e77f06a-967d-4e17-9254-dd0237ec8d0e" status: 200 len: 1267 microversion: 2.1 time: 0.299543 Aug 24 07:46:13.238113 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 358/710] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:46:12 2022] GET /compute/v2.1/servers/0e77f06a-967d-4e17-9254-dd0237ec8d0e => generated 1267 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:46:13.305333 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-6ffa0823-d18a-48dc-b8ee-638aa28717ac tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-518907949", "imageRef": "4358f547-a499-43f3-9c84-925d78cd73db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "34afa070-0362-4f42-ac1a-67e0122ae46a"}], "security_groups": [{"name": "tempest-securitygroup--1543976693"}], "key_name": "tempest-keypair-1467060365", "user_data": "}} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:46:13.485760 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.network.neutron [None req-6ffa0823-d18a-48dc-b8ee-638aa28717ac tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] validate_networks() for [('34afa070-0362-4f42-ac1a-67e0122ae46a', None, None, None, None, None)] {{(pid=127113) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 07:46:13.763384 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [req-7e6f63a3-0d3b-42ae-93e7-d81b0c65647d req-692b7d05-7663-4656-bf0d-ba746a76d5f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e77f06a-967d-4e17-9254-dd0237ec8d0e", "tag": "93a5f212-19aa-44d9-bf70-225e89f629ea"}]} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:46:13.781749 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-7e6f63a3-0d3b-42ae-93e7-d81b0c65647d req-692b7d05-7663-4656-bf0d-ba746a76d5f2 service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:13.782757 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-7e6f63a3-0d3b-42ae-93e7-d81b0c65647d req-692b7d05-7663-4656-bf0d-ba746a76d5f2 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:13.783413 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-7e6f63a3-0d3b-42ae-93e7-d81b0c65647d req-692b7d05-7663-4656-bf0d-ba746a76d5f2 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:13.789793 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:13.800114 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.compute.server_external_events [req-7e6f63a3-0d3b-42ae-93e7-d81b0c65647d req-692b7d05-7663-4656-bf0d-ba746a76d5f2 service nova] Creating event network-changed:93a5f212-19aa-44d9-bf70-225e89f629ea for instance 0e77f06a-967d-4e17-9254-dd0237ec8d0e on hv-cinder-85427 Aug 24 07:46:13.805466 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [req-7e6f63a3-0d3b-42ae-93e7-d81b0c65647d req-692b7d05-7663-4656-bf0d-ba746a76d5f2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048431 Aug 24 07:46:13.806397 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 359/711] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:46:14.084635 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-fdfee21b-0c64-4a51-838a-eea913ed5615 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:14.086053 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-fdfee21b-0c64-4a51-838a-eea913ed5615 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 13cb624d-3028-4eaf-b4df-2983595448a0] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:14.095449 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fdfee21b-0c64-4a51-838a-eea913ed5615 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:14.096203 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fdfee21b-0c64-4a51-838a-eea913ed5615 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:14.096969 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fdfee21b-0c64-4a51-838a-eea913ed5615 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:14.097988 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fdfee21b-0c64-4a51-838a-eea913ed5615 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:14.098636 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fdfee21b-0c64-4a51-838a-eea913ed5615 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:14.099237 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fdfee21b-0c64-4a51-838a-eea913ed5615 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:14.294316 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-fdfee21b-0c64-4a51-838a-eea913ed5615 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:14.304395 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-fdfee21b-0c64-4a51-838a-eea913ed5615 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0" status: 200 len: 1674 microversion: 2.1 time: 0.224859 Aug 24 07:46:14.305148 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 360/712] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:46:14 2022] GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0 => generated 1674 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:46:14.310491 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-633c703c-df0d-4f47-afdd-929e3d6022c1 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:14.311379 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-633c703c-df0d-4f47-afdd-929e3d6022c1 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 0e77f06a-967d-4e17-9254-dd0237ec8d0e] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:14.317282 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-633c703c-df0d-4f47-afdd-929e3d6022c1 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:14.318168 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-633c703c-df0d-4f47-afdd-929e3d6022c1 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:14.318716 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-633c703c-df0d-4f47-afdd-929e3d6022c1 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:14.319575 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-633c703c-df0d-4f47-afdd-929e3d6022c1 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:14.320115 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-633c703c-df0d-4f47-afdd-929e3d6022c1 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:14.320597 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-633c703c-df0d-4f47-afdd-929e3d6022c1 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:14.401594 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.virt.hardware [None req-6ffa0823-d18a-48dc-b8ee-638aa28717ac tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Flavor limits 0:0:0 {{(pid=127113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 07:46:14.402614 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.virt.hardware [None req-6ffa0823-d18a-48dc-b8ee-638aa28717ac tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Image limits 0:0:0 {{(pid=127113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 07:46:14.403496 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.virt.hardware [None req-6ffa0823-d18a-48dc-b8ee-638aa28717ac tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Flavor pref 0:0:0 {{(pid=127113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 07:46:14.403977 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.virt.hardware [None req-6ffa0823-d18a-48dc-b8ee-638aa28717ac tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Image pref 0:0:0 {{(pid=127113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 07:46:14.404462 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.virt.hardware [None req-6ffa0823-d18a-48dc-b8ee-638aa28717ac tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 07:46:14.415090 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6ffa0823-d18a-48dc-b8ee-638aa28717ac tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:14.415814 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6ffa0823-d18a-48dc-b8ee-638aa28717ac tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:14.416248 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6ffa0823-d18a-48dc-b8ee-638aa28717ac tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:14.416974 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6ffa0823-d18a-48dc-b8ee-638aa28717ac tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:14.417423 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6ffa0823-d18a-48dc-b8ee-638aa28717ac tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:14.417844 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6ffa0823-d18a-48dc-b8ee-638aa28717ac tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:14.436046 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.quota [None req-6ffa0823-d18a-48dc-b8ee-638aa28717ac tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Getting quotas for project af5acb73124c485aa87e60b4e5d4f6d4. Resources: {'cores', 'ram', 'instances'} {{(pid=127113) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:46:14.440136 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.quota [None req-6ffa0823-d18a-48dc-b8ee-638aa28717ac tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Getting quotas for user f594c9344b2c472ba33ceef87ec88a0b and project af5acb73124c485aa87e60b4e5d4f6d4. Resources: {'cores', 'ram', 'instances'} {{(pid=127113) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:46:14.451283 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-6ffa0823-d18a-48dc-b8ee-638aa28717ac tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Going to run 1 instances... {{(pid=127113) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 07:46:14.453070 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-633c703c-df0d-4f47-afdd-929e3d6022c1 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:14.454084 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-6ffa0823-d18a-48dc-b8ee-638aa28717ac tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: ac3c9f36-8b18-45dd-b610-76ffb47d5ae3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4358f547-a499-43f3-9c84-925d78cd73db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127113) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 07:46:14.461636 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-633c703c-df0d-4f47-afdd-929e3d6022c1 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/0e77f06a-967d-4e17-9254-dd0237ec8d0e" status: 200 len: 1267 microversion: 2.1 time: 0.155171 Aug 24 07:46:14.462195 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 361/713] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:46:14 2022] GET /compute/v2.1/servers/0e77f06a-967d-4e17-9254-dd0237ec8d0e => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:46:14.518749 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-6ffa0823-d18a-48dc-b8ee-638aa28717ac tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.217412 Aug 24 07:46:14.531557 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-93b81f0f-6cdc-432c-acae-47761b86bfcf tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:14.540788 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 353/714] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 24 07:46:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 1227 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 07:46:14.545708 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-93b81f0f-6cdc-432c-acae-47761b86bfcf tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: ac3c9f36-8b18-45dd-b610-76ffb47d5ae3] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:14.622375 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-93b81f0f-6cdc-432c-acae-47761b86bfcf tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:14.633636 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-93b81f0f-6cdc-432c-acae-47761b86bfcf tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3" status: 200 len: 1241 microversion: 2.1 time: 0.106386 Aug 24 07:46:14.635440 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 362/715] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:46:14 2022] GET /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3 => generated 1241 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:46:14.961081 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [req-c0b30aef-5024-4219-ae97-9c0d22c27506 req-65107108-24b0-4e4a-94d7-1a884c846728 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13cb624d-3028-4eaf-b4df-2983595448a0", "name": "network-vif-deleted", "tag": "c9648457-ce05-40d7-8216-6e29fae87db0"}]} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:46:14.980669 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-c0b30aef-5024-4219-ae97-9c0d22c27506 req-65107108-24b0-4e4a-94d7-1a884c846728 service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:14.981742 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-c0b30aef-5024-4219-ae97-9c0d22c27506 req-65107108-24b0-4e4a-94d7-1a884c846728 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:14.988917 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-c0b30aef-5024-4219-ae97-9c0d22c27506 req-65107108-24b0-4e4a-94d7-1a884c846728 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:15.007769 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.compute.server_external_events [req-c0b30aef-5024-4219-ae97-9c0d22c27506 req-65107108-24b0-4e4a-94d7-1a884c846728 service nova] Creating event network-vif-deleted:c9648457-ce05-40d7-8216-6e29fae87db0 for instance 13cb624d-3028-4eaf-b4df-2983595448a0 on hv-cinder-85427 Aug 24 07:46:15.014468 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [req-c0b30aef-5024-4219-ae97-9c0d22c27506 req-65107108-24b0-4e4a-94d7-1a884c846728 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155720 Aug 24 07:46:15.020436 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 354/716] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:46:15.330336 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-32808db1-f449-4e60-8a3b-b2dcd6711aab tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:15.331013 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-32808db1-f449-4e60-8a3b-b2dcd6711aab tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 13cb624d-3028-4eaf-b4df-2983595448a0] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:15.347218 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-32808db1-f449-4e60-8a3b-b2dcd6711aab tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:15.347712 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-32808db1-f449-4e60-8a3b-b2dcd6711aab tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:15.348151 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-32808db1-f449-4e60-8a3b-b2dcd6711aab tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:15.350457 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-32808db1-f449-4e60-8a3b-b2dcd6711aab tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:15.350934 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-32808db1-f449-4e60-8a3b-b2dcd6711aab tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:15.352634 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-32808db1-f449-4e60-8a3b-b2dcd6711aab tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:15.414241 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-32808db1-f449-4e60-8a3b-b2dcd6711aab tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:15.414750 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-32808db1-f449-4e60-8a3b-b2dcd6711aab tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:15.415186 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-32808db1-f449-4e60-8a3b-b2dcd6711aab tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:15.415628 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.objects.instance [None req-32808db1-f449-4e60-8a3b-b2dcd6711aab tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lazy-loading 'fault' on Instance uuid 13cb624d-3028-4eaf-b4df-2983595448a0 {{(pid=127114) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:46:15.462710 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-32808db1-f449-4e60-8a3b-b2dcd6711aab tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072548785a38488db94ee05dfbf8c8ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9b29dbfd404c008fe871808d41e059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:15.473559 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-32808db1-f449-4e60-8a3b-b2dcd6711aab tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0" status: 200 len: 1326 microversion: 2.1 time: 0.152036 Aug 24 07:46:15.476094 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 363/717] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:46:15 2022] GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0 => generated 1326 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:46:15.494100 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-c34e4be4-df01-4012-9a07-88e24431b0e9 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:15.495513 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-c34e4be4-df01-4012-9a07-88e24431b0e9 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 0e77f06a-967d-4e17-9254-dd0237ec8d0e] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:15.503048 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c34e4be4-df01-4012-9a07-88e24431b0e9 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:15.503761 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c34e4be4-df01-4012-9a07-88e24431b0e9 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:15.504399 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c34e4be4-df01-4012-9a07-88e24431b0e9 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:15.505266 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c34e4be4-df01-4012-9a07-88e24431b0e9 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:15.505719 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c34e4be4-df01-4012-9a07-88e24431b0e9 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:15.506157 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c34e4be4-df01-4012-9a07-88e24431b0e9 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:15.510549 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:15.648011 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-c34e4be4-df01-4012-9a07-88e24431b0e9 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:15.656014 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-c34e4be4-df01-4012-9a07-88e24431b0e9 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/0e77f06a-967d-4e17-9254-dd0237ec8d0e" status: 200 len: 1267 microversion: 2.1 time: 0.166032 Aug 24 07:46:15.656612 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 355/718] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:46:15 2022] GET /compute/v2.1/servers/0e77f06a-967d-4e17-9254-dd0237ec8d0e => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:46:15.656819 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-6ef50b76-fada-46e9-8911-97984b3f6d63 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:15.657857 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-6ef50b76-fada-46e9-8911-97984b3f6d63 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: ac3c9f36-8b18-45dd-b610-76ffb47d5ae3] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:15.664054 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6ef50b76-fada-46e9-8911-97984b3f6d63 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:15.664534 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6ef50b76-fada-46e9-8911-97984b3f6d63 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:15.664961 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6ef50b76-fada-46e9-8911-97984b3f6d63 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:15.665641 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6ef50b76-fada-46e9-8911-97984b3f6d63 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:15.666103 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6ef50b76-fada-46e9-8911-97984b3f6d63 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:15.666688 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6ef50b76-fada-46e9-8911-97984b3f6d63 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:15.730473 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-6ef50b76-fada-46e9-8911-97984b3f6d63 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:15.737914 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-6ef50b76-fada-46e9-8911-97984b3f6d63 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3" status: 200 len: 1293 microversion: 2.1 time: 0.085088 Aug 24 07:46:15.738471 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 364/719] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:46:15 2022] GET /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3 => generated 1293 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:46:16.496241 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-5fdd0992-f40f-4499-a396-c438191ee361 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:16.496857 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-5fdd0992-f40f-4499-a396-c438191ee361 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 13cb624d-3028-4eaf-b4df-2983595448a0] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:16.503780 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5fdd0992-f40f-4499-a396-c438191ee361 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:16.504260 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5fdd0992-f40f-4499-a396-c438191ee361 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:16.504683 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5fdd0992-f40f-4499-a396-c438191ee361 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:16.505379 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5fdd0992-f40f-4499-a396-c438191ee361 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:16.505828 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5fdd0992-f40f-4499-a396-c438191ee361 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:16.506242 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5fdd0992-f40f-4499-a396-c438191ee361 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:16.521359 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.wsgi [None req-5fdd0992-f40f-4499-a396-c438191ee361 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] HTTP exception thrown: Instance 13cb624d-3028-4eaf-b4df-2983595448a0 could not be found. Aug 24 07:46:16.523133 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-5fdd0992-f40f-4499-a396-c438191ee361 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Request method failure captured: Aug 24 07:46:16.523133 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: request: GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0 HTTP/1.1 Aug 24 07:46:16.523133 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept: application/json Aug 24 07:46:16.523133 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept-Encoding: identity Aug 24 07:46:16.523133 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Connection: close Aug 24 07:46:16.523133 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Length: 0 Aug 24 07:46:16.523133 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Type: application/json Aug 24 07:46:16.523133 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Host: 10.222.0.42 Aug 24 07:46:16.523133 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Openstack-System-Scope: None Aug 24 07:46:16.523133 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: User-Agent: python-urllib3/1.26.11 Aug 24 07:46:16.523133 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Auth-Token: gAAAAABjBdXbRtskbQhOYObAHeZbK0sYucBoh7btNygp0xhMBdo5krTvqePibR8j4N6RRXC__H4GHozQyHcP9FJb5i_cDdVAB1VHwI9Wkt13q_acNeJCMzKhq3rgo9EKtnKV2XHS_HW9Bb7oejzyFpKgCkMHLTzYdFr249MEYEMPshat84Z8zvY Aug 24 07:46:16.523133 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Id: None Aug 24 07:46:16.523133 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Name: None Aug 24 07:46:16.523133 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Identity-Status: Confirmed Aug 24 07:46:16.523133 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Is-Admin-Project: True Aug 24 07:46:16.523133 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Id: default Aug 24 07:46:16.523133 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Name: Default Aug 24 07:46:16.523133 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Id: 3e9b29dbfd404c008fe871808d41e059 Aug 24 07:46:16.523133 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Name: tempest-AttachVolumeTestJSON-1817292289 Aug 24 07:46:16.523133 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Role: reader,member Aug 24 07:46:16.523133 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Roles: reader,member Aug 24 07:46:16.524702 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3e9b29dbfd404c008fe871808d41e059"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3e9b29dbfd404c008fe871808d41e059", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3e9b29dbfd404c008fe871808d41e059"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3e9b29dbfd404c008fe871808d41e059"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:46:16.524702 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant: tempest-AttachVolumeTestJSON-1817292289 Aug 24 07:46:16.524702 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Id: 3e9b29dbfd404c008fe871808d41e059 Aug 24 07:46:16.524702 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1817292289 Aug 24 07:46:16.524702 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User: tempest-AttachVolumeTestJSON-1817292289-project Aug 24 07:46:16.524702 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Id: default Aug 24 07:46:16.524702 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Name: Default Aug 24 07:46:16.524702 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Id: 072548785a38488db94ee05dfbf8c8ec Aug 24 07:46:16.524702 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Name: tempest-AttachVolumeTestJSON-1817292289-project Aug 24 07:46:16.524702 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: method: > Aug 24 07:46:16.524702 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: exception: Instance 13cb624d-3028-4eaf-b4df-2983595448a0 could not be found. Aug 24 07:46:16.524702 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: action_args: {'id': '13cb624d-3028-4eaf-b4df-2983595448a0'} Aug 24 07:46:16.529337 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:46:16.529337 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:46:16.529337 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:46:16.529337 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:46:16.529337 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:46:16.529337 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:46:16.529337 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:46:16.529337 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:46:16.529337 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:46:16.529337 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:46:16.529337 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13cb624d-3028-4eaf-b4df-2983595448a0 could not be found. Aug 24 07:46:16.529337 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:46:16.529337 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:46:16.529337 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:46:16.529337 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:46:16.529337 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:46:16.529337 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:46:16.529337 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:46:16.529337 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:46:16.529337 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:46:16.530974 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:46:16.530974 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 07:46:16.530974 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 07:46:16.530974 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:46:16.530974 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:46:16.530974 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:46:16.530974 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:46:16.530974 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13cb624d-3028-4eaf-b4df-2983595448a0 could not be found. Aug 24 07:46:16.530974 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:46:16.530974 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:46:16.530974 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:46:16.530974 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:46:16.530974 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:46:16.530974 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:46:16.530974 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:46:16.530974 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:46:16.530974 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13cb624d-3028-4eaf-b4df-2983595448a0 could not be found. Aug 24 07:46:16.530974 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:46:16.532834 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-5fdd0992-f40f-4499-a396-c438191ee361 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Returning 404 to user: Instance 13cb624d-3028-4eaf-b4df-2983595448a0 could not be found. {{(pid=127113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:46:16.532834 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-5fdd0992-f40f-4499-a396-c438191ee361 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0" status: 404 len: 111 microversion: 2.1 time: 0.032244 Aug 24 07:46:16.532834 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 356/720] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:46:16 2022] GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:46:16.534102 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-23cfa0a9-52ab-45d0-925d-cca4728168cd tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '.version_select at 0x7faf68536a60>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:16.554541 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-23cfa0a9-52ab-45d0-925d-cca4728168cd tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-526182087" status: 202 len: 0 microversion: 2.1 time: 0.024776 Aug 24 07:46:16.555322 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 365/721] 10.222.0.42 () {58 vars in 1218 bytes} [Wed Aug 24 07:46:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-526182087 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 07:46:16.676240 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-daaf37c5-5d68-4f58-bede-abe359552c04 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:16.677133 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-daaf37c5-5d68-4f58-bede-abe359552c04 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 0e77f06a-967d-4e17-9254-dd0237ec8d0e] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:16.683679 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-daaf37c5-5d68-4f58-bede-abe359552c04 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:16.684373 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-daaf37c5-5d68-4f58-bede-abe359552c04 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:16.684982 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-daaf37c5-5d68-4f58-bede-abe359552c04 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:16.685841 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-daaf37c5-5d68-4f58-bede-abe359552c04 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:16.686433 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-daaf37c5-5d68-4f58-bede-abe359552c04 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:16.687047 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-daaf37c5-5d68-4f58-bede-abe359552c04 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:16.759557 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-90959bd0-747e-4f4a-9423-cb1c073f6b56 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:16.760337 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-90959bd0-747e-4f4a-9423-cb1c073f6b56 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: ac3c9f36-8b18-45dd-b610-76ffb47d5ae3] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:16.769285 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-90959bd0-747e-4f4a-9423-cb1c073f6b56 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:16.770339 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-90959bd0-747e-4f4a-9423-cb1c073f6b56 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:16.770954 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-90959bd0-747e-4f4a-9423-cb1c073f6b56 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:16.771840 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-90959bd0-747e-4f4a-9423-cb1c073f6b56 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:16.772496 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-90959bd0-747e-4f4a-9423-cb1c073f6b56 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:16.773191 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-90959bd0-747e-4f4a-9423-cb1c073f6b56 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:16.850822 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-daaf37c5-5d68-4f58-bede-abe359552c04 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:16.860011 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-daaf37c5-5d68-4f58-bede-abe359552c04 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/0e77f06a-967d-4e17-9254-dd0237ec8d0e" status: 200 len: 1267 microversion: 2.1 time: 0.187781 Aug 24 07:46:16.860616 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 357/722] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:46:16 2022] GET /compute/v2.1/servers/0e77f06a-967d-4e17-9254-dd0237ec8d0e => generated 1267 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:46:17.135595 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-90959bd0-747e-4f4a-9423-cb1c073f6b56 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:17.143940 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-90959bd0-747e-4f4a-9423-cb1c073f6b56 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3" status: 200 len: 1367 microversion: 2.1 time: 0.389299 Aug 24 07:46:17.144733 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 366/723] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:46:16 2022] GET /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3 => generated 1367 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:46:17.881995 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-52bc4827-7bda-4d82-9ccd-dbf0a537d23d tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:17.882634 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-52bc4827-7bda-4d82-9ccd-dbf0a537d23d tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 0e77f06a-967d-4e17-9254-dd0237ec8d0e] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:17.890136 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-52bc4827-7bda-4d82-9ccd-dbf0a537d23d tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:17.891253 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-52bc4827-7bda-4d82-9ccd-dbf0a537d23d tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:17.891700 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-52bc4827-7bda-4d82-9ccd-dbf0a537d23d tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:17.892394 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-52bc4827-7bda-4d82-9ccd-dbf0a537d23d tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:17.892848 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-52bc4827-7bda-4d82-9ccd-dbf0a537d23d tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:17.893435 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-52bc4827-7bda-4d82-9ccd-dbf0a537d23d tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:17.917092 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [req-a4709cb5-93d5-4c8a-b559-bb0f67b37ce9 req-e66180c2-a0c6-4e6b-a725-09245a2b73af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac3c9f36-8b18-45dd-b610-76ffb47d5ae3", "tag": "17a47887-5c6a-4b79-966d-dadcb55f1b9c"}]} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:46:17.929323 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-a4709cb5-93d5-4c8a-b559-bb0f67b37ce9 req-e66180c2-a0c6-4e6b-a725-09245a2b73af service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:17.930321 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-a4709cb5-93d5-4c8a-b559-bb0f67b37ce9 req-e66180c2-a0c6-4e6b-a725-09245a2b73af service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:17.930939 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-a4709cb5-93d5-4c8a-b559-bb0f67b37ce9 req-e66180c2-a0c6-4e6b-a725-09245a2b73af service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:17.944244 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.compute.server_external_events [req-a4709cb5-93d5-4c8a-b559-bb0f67b37ce9 req-e66180c2-a0c6-4e6b-a725-09245a2b73af service nova] Creating event network-changed:17a47887-5c6a-4b79-966d-dadcb55f1b9c for instance ac3c9f36-8b18-45dd-b610-76ffb47d5ae3 on hv-cinder-85427 Aug 24 07:46:17.952348 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [req-a4709cb5-93d5-4c8a-b559-bb0f67b37ce9 req-e66180c2-a0c6-4e6b-a725-09245a2b73af service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039952 Aug 24 07:46:17.954044 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 367/724] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:46:18.043103 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-52bc4827-7bda-4d82-9ccd-dbf0a537d23d tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:18.051573 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-52bc4827-7bda-4d82-9ccd-dbf0a537d23d tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/0e77f06a-967d-4e17-9254-dd0237ec8d0e" status: 200 len: 1267 microversion: 2.1 time: 0.174037 Aug 24 07:46:18.052180 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 358/725] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:46:17 2022] GET /compute/v2.1/servers/0e77f06a-967d-4e17-9254-dd0237ec8d0e => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:46:18.165679 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-fe671610-c387-4ef7-8071-6348c1739f1d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:18.166473 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-fe671610-c387-4ef7-8071-6348c1739f1d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: ac3c9f36-8b18-45dd-b610-76ffb47d5ae3] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:18.173324 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fe671610-c387-4ef7-8071-6348c1739f1d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:18.173803 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fe671610-c387-4ef7-8071-6348c1739f1d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:18.174229 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fe671610-c387-4ef7-8071-6348c1739f1d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:18.174954 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fe671610-c387-4ef7-8071-6348c1739f1d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:18.175407 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fe671610-c387-4ef7-8071-6348c1739f1d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:18.175823 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fe671610-c387-4ef7-8071-6348c1739f1d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:18.373218 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-fe671610-c387-4ef7-8071-6348c1739f1d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:18.381051 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-fe671610-c387-4ef7-8071-6348c1739f1d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3" status: 200 len: 1367 microversion: 2.1 time: 0.219561 Aug 24 07:46:18.381656 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 368/726] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:46:18 2022] GET /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3 => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:46:19.072873 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-356ffbe8-7f8c-45fc-8d1b-e22e7490aded tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:19.073485 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-356ffbe8-7f8c-45fc-8d1b-e22e7490aded tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 0e77f06a-967d-4e17-9254-dd0237ec8d0e] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:19.079885 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-356ffbe8-7f8c-45fc-8d1b-e22e7490aded tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:19.080367 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-356ffbe8-7f8c-45fc-8d1b-e22e7490aded tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:19.080801 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-356ffbe8-7f8c-45fc-8d1b-e22e7490aded tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:19.081494 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-356ffbe8-7f8c-45fc-8d1b-e22e7490aded tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:19.081945 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-356ffbe8-7f8c-45fc-8d1b-e22e7490aded tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:19.082374 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-356ffbe8-7f8c-45fc-8d1b-e22e7490aded tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:19.209366 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-356ffbe8-7f8c-45fc-8d1b-e22e7490aded tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:19.216950 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-356ffbe8-7f8c-45fc-8d1b-e22e7490aded tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/0e77f06a-967d-4e17-9254-dd0237ec8d0e" status: 200 len: 1267 microversion: 2.1 time: 0.147965 Aug 24 07:46:19.217506 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 359/727] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:46:19 2022] GET /compute/v2.1/servers/0e77f06a-967d-4e17-9254-dd0237ec8d0e => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:46:19.401347 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-f8c7c73f-1c87-4bf1-a6d5-ade9837b7878 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:19.401960 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-f8c7c73f-1c87-4bf1-a6d5-ade9837b7878 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: ac3c9f36-8b18-45dd-b610-76ffb47d5ae3] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:19.409156 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f8c7c73f-1c87-4bf1-a6d5-ade9837b7878 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:19.409714 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f8c7c73f-1c87-4bf1-a6d5-ade9837b7878 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:19.410150 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f8c7c73f-1c87-4bf1-a6d5-ade9837b7878 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:19.410879 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f8c7c73f-1c87-4bf1-a6d5-ade9837b7878 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:19.411331 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f8c7c73f-1c87-4bf1-a6d5-ade9837b7878 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:19.411747 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f8c7c73f-1c87-4bf1-a6d5-ade9837b7878 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:19.537597 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-f8c7c73f-1c87-4bf1-a6d5-ade9837b7878 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:19.545036 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-f8c7c73f-1c87-4bf1-a6d5-ade9837b7878 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3" status: 200 len: 1367 microversion: 2.1 time: 0.147612 Aug 24 07:46:19.545599 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 369/728] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:46:19 2022] GET /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:46:19.889376 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-fbc91e30-f37c-47bf-b62b-b038b81cd953 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:19.889870 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-fbc91e30-f37c-47bf-b62b-b038b81cd953 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 13cb624d-3028-4eaf-b4df-2983595448a0] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:19.896317 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-fbc91e30-f37c-47bf-b62b-b038b81cd953 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:19.896796 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-fbc91e30-f37c-47bf-b62b-b038b81cd953 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:19.897228 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-fbc91e30-f37c-47bf-b62b-b038b81cd953 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:19.897906 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-fbc91e30-f37c-47bf-b62b-b038b81cd953 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:19.898356 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-fbc91e30-f37c-47bf-b62b-b038b81cd953 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:19.898809 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-fbc91e30-f37c-47bf-b62b-b038b81cd953 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:19.912296 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.wsgi [None req-fbc91e30-f37c-47bf-b62b-b038b81cd953 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] HTTP exception thrown: Instance 13cb624d-3028-4eaf-b4df-2983595448a0 could not be found. Aug 24 07:46:19.913828 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-fbc91e30-f37c-47bf-b62b-b038b81cd953 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Request method failure captured: Aug 24 07:46:19.913828 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: request: DELETE /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0 HTTP/1.1 Aug 24 07:46:19.913828 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept: application/json Aug 24 07:46:19.913828 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept-Encoding: identity Aug 24 07:46:19.913828 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Connection: close Aug 24 07:46:19.913828 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Length: 0 Aug 24 07:46:19.913828 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Type: application/json Aug 24 07:46:19.913828 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Host: 10.222.0.42 Aug 24 07:46:19.913828 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Openstack-System-Scope: None Aug 24 07:46:19.913828 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: User-Agent: python-urllib3/1.26.11 Aug 24 07:46:19.913828 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Auth-Token: gAAAAABjBdXbRtskbQhOYObAHeZbK0sYucBoh7btNygp0xhMBdo5krTvqePibR8j4N6RRXC__H4GHozQyHcP9FJb5i_cDdVAB1VHwI9Wkt13q_acNeJCMzKhq3rgo9EKtnKV2XHS_HW9Bb7oejzyFpKgCkMHLTzYdFr249MEYEMPshat84Z8zvY Aug 24 07:46:19.913828 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Id: None Aug 24 07:46:19.913828 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Name: None Aug 24 07:46:19.913828 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Identity-Status: Confirmed Aug 24 07:46:19.913828 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Is-Admin-Project: True Aug 24 07:46:19.913828 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Id: default Aug 24 07:46:19.913828 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Name: Default Aug 24 07:46:19.913828 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Id: 3e9b29dbfd404c008fe871808d41e059 Aug 24 07:46:19.913828 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Name: tempest-AttachVolumeTestJSON-1817292289 Aug 24 07:46:19.913828 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Role: reader,member Aug 24 07:46:19.913828 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Roles: reader,member Aug 24 07:46:19.915403 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3e9b29dbfd404c008fe871808d41e059"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3e9b29dbfd404c008fe871808d41e059", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3e9b29dbfd404c008fe871808d41e059"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3e9b29dbfd404c008fe871808d41e059"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:46:19.915403 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant: tempest-AttachVolumeTestJSON-1817292289 Aug 24 07:46:19.915403 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Id: 3e9b29dbfd404c008fe871808d41e059 Aug 24 07:46:19.915403 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1817292289 Aug 24 07:46:19.915403 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User: tempest-AttachVolumeTestJSON-1817292289-project Aug 24 07:46:19.915403 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Id: default Aug 24 07:46:19.915403 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Name: Default Aug 24 07:46:19.915403 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Id: 072548785a38488db94ee05dfbf8c8ec Aug 24 07:46:19.915403 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Name: tempest-AttachVolumeTestJSON-1817292289-project Aug 24 07:46:19.915403 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: method: > Aug 24 07:46:19.915403 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: exception: Instance 13cb624d-3028-4eaf-b4df-2983595448a0 could not be found. Aug 24 07:46:19.915403 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: action_args: {'id': '13cb624d-3028-4eaf-b4df-2983595448a0'} Aug 24 07:46:19.916423 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:46:19.916423 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:46:19.916423 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:46:19.916423 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:46:19.916423 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:46:19.916423 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:46:19.916423 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:46:19.916423 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:46:19.916423 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:46:19.916423 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:46:19.916423 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13cb624d-3028-4eaf-b4df-2983595448a0 could not be found. Aug 24 07:46:19.916423 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:46:19.916423 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:46:19.916423 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:46:19.916423 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:46:19.916423 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:46:19.916423 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:46:19.916423 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:46:19.916423 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:46:19.916423 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:46:19.917975 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:46:19.917975 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 07:46:19.917975 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 07:46:19.917975 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 07:46:19.917975 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 07:46:19.917975 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:46:19.917975 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:46:19.917975 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:46:19.917975 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:46:19.917975 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13cb624d-3028-4eaf-b4df-2983595448a0 could not be found. Aug 24 07:46:19.917975 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:46:19.917975 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:46:19.917975 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:46:19.917975 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:46:19.917975 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:46:19.917975 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:46:19.917975 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:46:19.917975 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:46:19.917975 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13cb624d-3028-4eaf-b4df-2983595448a0 could not be found. Aug 24 07:46:19.917975 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:46:19.919782 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-fbc91e30-f37c-47bf-b62b-b038b81cd953 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Returning 404 to user: Instance 13cb624d-3028-4eaf-b4df-2983595448a0 could not be found. {{(pid=127113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:46:19.919782 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-fbc91e30-f37c-47bf-b62b-b038b81cd953 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "DELETE /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0" status: 404 len: 111 microversion: 2.1 time: 0.029695 Aug 24 07:46:19.919782 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 360/729] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 24 07:46:19 2022] DELETE /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:46:19.924230 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-37af2ef7-7f17-44ab-bd4d-42f2de8277f5 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:19.924857 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-37af2ef7-7f17-44ab-bd4d-42f2de8277f5 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 13cb624d-3028-4eaf-b4df-2983595448a0] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:19.930838 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-37af2ef7-7f17-44ab-bd4d-42f2de8277f5 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:19.931318 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-37af2ef7-7f17-44ab-bd4d-42f2de8277f5 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:19.931747 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-37af2ef7-7f17-44ab-bd4d-42f2de8277f5 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:19.932426 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-37af2ef7-7f17-44ab-bd4d-42f2de8277f5 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:19.932876 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-37af2ef7-7f17-44ab-bd4d-42f2de8277f5 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:19.933298 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-37af2ef7-7f17-44ab-bd4d-42f2de8277f5 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:19.948642 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.wsgi [None req-37af2ef7-7f17-44ab-bd4d-42f2de8277f5 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] HTTP exception thrown: Instance 13cb624d-3028-4eaf-b4df-2983595448a0 could not be found. Aug 24 07:46:19.950250 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-37af2ef7-7f17-44ab-bd4d-42f2de8277f5 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Request method failure captured: Aug 24 07:46:19.950250 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: request: GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0 HTTP/1.1 Aug 24 07:46:19.950250 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept: application/json Aug 24 07:46:19.950250 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept-Encoding: identity Aug 24 07:46:19.950250 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Connection: close Aug 24 07:46:19.950250 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Length: 0 Aug 24 07:46:19.950250 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Type: application/json Aug 24 07:46:19.950250 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Host: 10.222.0.42 Aug 24 07:46:19.950250 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Openstack-System-Scope: None Aug 24 07:46:19.950250 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: User-Agent: python-urllib3/1.26.11 Aug 24 07:46:19.950250 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Auth-Token: gAAAAABjBdXbRtskbQhOYObAHeZbK0sYucBoh7btNygp0xhMBdo5krTvqePibR8j4N6RRXC__H4GHozQyHcP9FJb5i_cDdVAB1VHwI9Wkt13q_acNeJCMzKhq3rgo9EKtnKV2XHS_HW9Bb7oejzyFpKgCkMHLTzYdFr249MEYEMPshat84Z8zvY Aug 24 07:46:19.950250 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Id: None Aug 24 07:46:19.950250 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Name: None Aug 24 07:46:19.950250 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Identity-Status: Confirmed Aug 24 07:46:19.950250 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Is-Admin-Project: True Aug 24 07:46:19.950250 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Id: default Aug 24 07:46:19.950250 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Name: Default Aug 24 07:46:19.950250 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Id: 3e9b29dbfd404c008fe871808d41e059 Aug 24 07:46:19.950250 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Name: tempest-AttachVolumeTestJSON-1817292289 Aug 24 07:46:19.950250 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Role: reader,member Aug 24 07:46:19.950250 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Roles: reader,member Aug 24 07:46:19.951839 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3e9b29dbfd404c008fe871808d41e059"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3e9b29dbfd404c008fe871808d41e059", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3e9b29dbfd404c008fe871808d41e059"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3e9b29dbfd404c008fe871808d41e059"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:46:19.951839 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant: tempest-AttachVolumeTestJSON-1817292289 Aug 24 07:46:19.951839 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Id: 3e9b29dbfd404c008fe871808d41e059 Aug 24 07:46:19.951839 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1817292289 Aug 24 07:46:19.951839 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User: tempest-AttachVolumeTestJSON-1817292289-project Aug 24 07:46:19.951839 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Id: default Aug 24 07:46:19.951839 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Name: Default Aug 24 07:46:19.951839 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Id: 072548785a38488db94ee05dfbf8c8ec Aug 24 07:46:19.951839 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Name: tempest-AttachVolumeTestJSON-1817292289-project Aug 24 07:46:19.951839 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: method: > Aug 24 07:46:19.951839 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: exception: Instance 13cb624d-3028-4eaf-b4df-2983595448a0 could not be found. Aug 24 07:46:19.951839 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: action_args: {'id': '13cb624d-3028-4eaf-b4df-2983595448a0'} Aug 24 07:46:19.952691 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:46:19.952691 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:46:19.952691 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:46:19.952691 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:46:19.952691 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:46:19.952691 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:46:19.952691 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:46:19.952691 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:46:19.952691 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:46:19.952691 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:46:19.952691 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13cb624d-3028-4eaf-b4df-2983595448a0 could not be found. Aug 24 07:46:19.952691 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:46:19.952691 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:46:19.952691 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:46:19.952691 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:46:19.952691 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:46:19.952691 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:46:19.952691 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:46:19.952691 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:46:19.952691 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:46:19.954164 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:46:19.954164 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 07:46:19.954164 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 07:46:19.954164 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:46:19.954164 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:46:19.954164 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:46:19.954164 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:46:19.954164 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13cb624d-3028-4eaf-b4df-2983595448a0 could not be found. Aug 24 07:46:19.954164 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:46:19.954164 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:46:19.954164 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:46:19.954164 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:46:19.954164 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:46:19.954164 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:46:19.954164 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:46:19.954164 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:46:19.954164 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13cb624d-3028-4eaf-b4df-2983595448a0 could not be found. Aug 24 07:46:19.954164 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:46:19.955494 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-37af2ef7-7f17-44ab-bd4d-42f2de8277f5 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Returning 404 to user: Instance 13cb624d-3028-4eaf-b4df-2983595448a0 could not be found. {{(pid=127114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:46:19.955494 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-37af2ef7-7f17-44ab-bd4d-42f2de8277f5 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0" status: 404 len: 111 microversion: 2.1 time: 0.032069 Aug 24 07:46:19.955494 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 370/730] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:46:19 2022] GET /compute/v2.1/servers/13cb624d-3028-4eaf-b4df-2983595448a0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:46:20.237926 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-c741f57e-1761-49ad-ad19-7a253891dd66 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:20.238711 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-c741f57e-1761-49ad-ad19-7a253891dd66 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 0e77f06a-967d-4e17-9254-dd0237ec8d0e] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:20.245421 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c741f57e-1761-49ad-ad19-7a253891dd66 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:20.245895 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c741f57e-1761-49ad-ad19-7a253891dd66 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:20.246318 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c741f57e-1761-49ad-ad19-7a253891dd66 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:20.247024 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c741f57e-1761-49ad-ad19-7a253891dd66 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:20.247468 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c741f57e-1761-49ad-ad19-7a253891dd66 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:20.247882 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c741f57e-1761-49ad-ad19-7a253891dd66 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:20.382263 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-c741f57e-1761-49ad-ad19-7a253891dd66 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:20.390657 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-c741f57e-1761-49ad-ad19-7a253891dd66 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/0e77f06a-967d-4e17-9254-dd0237ec8d0e" status: 200 len: 1267 microversion: 2.1 time: 0.157061 Aug 24 07:46:20.391448 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 361/731] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:46:20 2022] GET /compute/v2.1/servers/0e77f06a-967d-4e17-9254-dd0237ec8d0e => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:46:20.565838 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-af26b6d4-36ec-4b5e-801c-7fed69f8981d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:20.566585 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-af26b6d4-36ec-4b5e-801c-7fed69f8981d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: ac3c9f36-8b18-45dd-b610-76ffb47d5ae3] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:20.573032 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-af26b6d4-36ec-4b5e-801c-7fed69f8981d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:20.573508 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-af26b6d4-36ec-4b5e-801c-7fed69f8981d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:20.573935 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-af26b6d4-36ec-4b5e-801c-7fed69f8981d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:20.574621 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-af26b6d4-36ec-4b5e-801c-7fed69f8981d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:20.575104 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-af26b6d4-36ec-4b5e-801c-7fed69f8981d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:20.575522 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-af26b6d4-36ec-4b5e-801c-7fed69f8981d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:20.701401 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-af26b6d4-36ec-4b5e-801c-7fed69f8981d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:20.709435 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-af26b6d4-36ec-4b5e-801c-7fed69f8981d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3" status: 200 len: 1367 microversion: 2.1 time: 0.147466 Aug 24 07:46:20.709986 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 371/732] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:46:20 2022] GET /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:46:21.088795 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-3b6fc610-a45a-45fe-8211-6e9de313b889 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:21.089403 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-3b6fc610-a45a-45fe-8211-6e9de313b889 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:21.095861 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3b6fc610-a45a-45fe-8211-6e9de313b889 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:21.096342 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3b6fc610-a45a-45fe-8211-6e9de313b889 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:21.096768 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3b6fc610-a45a-45fe-8211-6e9de313b889 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:21.097454 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3b6fc610-a45a-45fe-8211-6e9de313b889 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:21.097905 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3b6fc610-a45a-45fe-8211-6e9de313b889 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:21.098332 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3b6fc610-a45a-45fe-8211-6e9de313b889 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:21.111217 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.wsgi [None req-3b6fc610-a45a-45fe-8211-6e9de313b889 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] HTTP exception thrown: Instance 63a5cb56-fccf-4fbe-be10-b637c616539c could not be found. Aug 24 07:46:21.112734 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-3b6fc610-a45a-45fe-8211-6e9de313b889 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Request method failure captured: Aug 24 07:46:21.112734 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: request: DELETE /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c HTTP/1.1 Aug 24 07:46:21.112734 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept: application/json Aug 24 07:46:21.112734 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept-Encoding: identity Aug 24 07:46:21.112734 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Connection: close Aug 24 07:46:21.112734 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Length: 0 Aug 24 07:46:21.112734 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Type: application/json Aug 24 07:46:21.112734 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Host: 10.222.0.42 Aug 24 07:46:21.112734 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Openstack-System-Scope: None Aug 24 07:46:21.112734 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: User-Agent: python-urllib3/1.26.11 Aug 24 07:46:21.112734 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Auth-Token: gAAAAABjBdXbRtskbQhOYObAHeZbK0sYucBoh7btNygp0xhMBdo5krTvqePibR8j4N6RRXC__H4GHozQyHcP9FJb5i_cDdVAB1VHwI9Wkt13q_acNeJCMzKhq3rgo9EKtnKV2XHS_HW9Bb7oejzyFpKgCkMHLTzYdFr249MEYEMPshat84Z8zvY Aug 24 07:46:21.112734 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Id: None Aug 24 07:46:21.112734 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Name: None Aug 24 07:46:21.112734 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Identity-Status: Confirmed Aug 24 07:46:21.112734 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Is-Admin-Project: True Aug 24 07:46:21.112734 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Id: default Aug 24 07:46:21.112734 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Name: Default Aug 24 07:46:21.112734 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Id: 3e9b29dbfd404c008fe871808d41e059 Aug 24 07:46:21.112734 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Name: tempest-AttachVolumeTestJSON-1817292289 Aug 24 07:46:21.112734 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Role: reader,member Aug 24 07:46:21.112734 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Roles: reader,member Aug 24 07:46:21.114225 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3e9b29dbfd404c008fe871808d41e059"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3e9b29dbfd404c008fe871808d41e059", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3e9b29dbfd404c008fe871808d41e059"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3e9b29dbfd404c008fe871808d41e059"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:46:21.114225 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant: tempest-AttachVolumeTestJSON-1817292289 Aug 24 07:46:21.114225 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Id: 3e9b29dbfd404c008fe871808d41e059 Aug 24 07:46:21.114225 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1817292289 Aug 24 07:46:21.114225 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User: tempest-AttachVolumeTestJSON-1817292289-project Aug 24 07:46:21.114225 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Id: default Aug 24 07:46:21.114225 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Name: Default Aug 24 07:46:21.114225 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Id: 072548785a38488db94ee05dfbf8c8ec Aug 24 07:46:21.114225 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Name: tempest-AttachVolumeTestJSON-1817292289-project Aug 24 07:46:21.114225 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: method: > Aug 24 07:46:21.114225 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: exception: Instance 63a5cb56-fccf-4fbe-be10-b637c616539c could not be found. Aug 24 07:46:21.114225 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: action_args: {'id': '63a5cb56-fccf-4fbe-be10-b637c616539c'} Aug 24 07:46:21.117862 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:46:21.117862 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:46:21.117862 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:46:21.117862 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:46:21.117862 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:46:21.117862 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:46:21.117862 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:46:21.117862 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:46:21.117862 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:46:21.117862 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:46:21.117862 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63a5cb56-fccf-4fbe-be10-b637c616539c could not be found. Aug 24 07:46:21.117862 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:46:21.117862 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:46:21.117862 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:46:21.117862 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:46:21.117862 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:46:21.117862 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:46:21.117862 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:46:21.117862 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:46:21.117862 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:46:21.119317 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:46:21.119317 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 07:46:21.119317 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 07:46:21.119317 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 07:46:21.119317 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 07:46:21.119317 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:46:21.119317 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:46:21.119317 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:46:21.119317 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:46:21.119317 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63a5cb56-fccf-4fbe-be10-b637c616539c could not be found. Aug 24 07:46:21.119317 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:46:21.119317 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:46:21.119317 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:46:21.119317 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:46:21.119317 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:46:21.119317 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:46:21.119317 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:46:21.119317 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:46:21.119317 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63a5cb56-fccf-4fbe-be10-b637c616539c could not be found. Aug 24 07:46:21.119317 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:46:21.120799 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-3b6fc610-a45a-45fe-8211-6e9de313b889 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Returning 404 to user: Instance 63a5cb56-fccf-4fbe-be10-b637c616539c could not be found. {{(pid=127113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:46:21.120799 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-3b6fc610-a45a-45fe-8211-6e9de313b889 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "DELETE /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 404 len: 111 microversion: 2.1 time: 0.029721 Aug 24 07:46:21.120799 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 362/733] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 24 07:46:21 2022] DELETE /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:46:21.122352 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-5f8bc3f7-0d99-41af-ac8e-2da18b4b47a7 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:21.122975 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-5f8bc3f7-0d99-41af-ac8e-2da18b4b47a7 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] [instance: 63a5cb56-fccf-4fbe-be10-b637c616539c] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:21.129315 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5f8bc3f7-0d99-41af-ac8e-2da18b4b47a7 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:21.129793 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5f8bc3f7-0d99-41af-ac8e-2da18b4b47a7 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:21.130225 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5f8bc3f7-0d99-41af-ac8e-2da18b4b47a7 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:21.130934 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5f8bc3f7-0d99-41af-ac8e-2da18b4b47a7 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:21.131388 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5f8bc3f7-0d99-41af-ac8e-2da18b4b47a7 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:21.131807 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5f8bc3f7-0d99-41af-ac8e-2da18b4b47a7 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:21.145295 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.wsgi [None req-5f8bc3f7-0d99-41af-ac8e-2da18b4b47a7 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] HTTP exception thrown: Instance 63a5cb56-fccf-4fbe-be10-b637c616539c could not be found. Aug 24 07:46:21.146802 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-5f8bc3f7-0d99-41af-ac8e-2da18b4b47a7 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Request method failure captured: Aug 24 07:46:21.146802 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: request: GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c HTTP/1.1 Aug 24 07:46:21.146802 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept: application/json Aug 24 07:46:21.146802 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept-Encoding: identity Aug 24 07:46:21.146802 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Connection: close Aug 24 07:46:21.146802 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Length: 0 Aug 24 07:46:21.146802 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Type: application/json Aug 24 07:46:21.146802 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Host: 10.222.0.42 Aug 24 07:46:21.146802 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Openstack-System-Scope: None Aug 24 07:46:21.146802 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: User-Agent: python-urllib3/1.26.11 Aug 24 07:46:21.146802 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Auth-Token: gAAAAABjBdXbRtskbQhOYObAHeZbK0sYucBoh7btNygp0xhMBdo5krTvqePibR8j4N6RRXC__H4GHozQyHcP9FJb5i_cDdVAB1VHwI9Wkt13q_acNeJCMzKhq3rgo9EKtnKV2XHS_HW9Bb7oejzyFpKgCkMHLTzYdFr249MEYEMPshat84Z8zvY Aug 24 07:46:21.146802 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Id: None Aug 24 07:46:21.146802 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Name: None Aug 24 07:46:21.146802 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Identity-Status: Confirmed Aug 24 07:46:21.146802 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Is-Admin-Project: True Aug 24 07:46:21.146802 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Id: default Aug 24 07:46:21.146802 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Name: Default Aug 24 07:46:21.146802 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Id: 3e9b29dbfd404c008fe871808d41e059 Aug 24 07:46:21.146802 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Name: tempest-AttachVolumeTestJSON-1817292289 Aug 24 07:46:21.146802 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Role: reader,member Aug 24 07:46:21.146802 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Roles: reader,member Aug 24 07:46:21.148273 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3e9b29dbfd404c008fe871808d41e059"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3e9b29dbfd404c008fe871808d41e059", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3e9b29dbfd404c008fe871808d41e059"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3e9b29dbfd404c008fe871808d41e059"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:46:21.148273 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant: tempest-AttachVolumeTestJSON-1817292289 Aug 24 07:46:21.148273 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Id: 3e9b29dbfd404c008fe871808d41e059 Aug 24 07:46:21.148273 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1817292289 Aug 24 07:46:21.148273 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User: tempest-AttachVolumeTestJSON-1817292289-project Aug 24 07:46:21.148273 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Id: default Aug 24 07:46:21.148273 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Name: Default Aug 24 07:46:21.148273 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Id: 072548785a38488db94ee05dfbf8c8ec Aug 24 07:46:21.148273 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Name: tempest-AttachVolumeTestJSON-1817292289-project Aug 24 07:46:21.148273 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: method: > Aug 24 07:46:21.148273 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: exception: Instance 63a5cb56-fccf-4fbe-be10-b637c616539c could not be found. Aug 24 07:46:21.148273 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: action_args: {'id': '63a5cb56-fccf-4fbe-be10-b637c616539c'} Aug 24 07:46:21.152328 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:46:21.152328 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:46:21.152328 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:46:21.152328 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:46:21.152328 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:46:21.152328 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:46:21.152328 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:46:21.152328 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:46:21.152328 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:46:21.152328 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:46:21.152328 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63a5cb56-fccf-4fbe-be10-b637c616539c could not be found. Aug 24 07:46:21.152328 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:46:21.152328 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:46:21.152328 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:46:21.152328 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:46:21.152328 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:46:21.152328 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:46:21.152328 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:46:21.152328 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:46:21.152328 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:46:21.153854 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:46:21.153854 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 07:46:21.153854 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 07:46:21.153854 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:46:21.153854 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:46:21.153854 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:46:21.153854 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:46:21.153854 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63a5cb56-fccf-4fbe-be10-b637c616539c could not be found. Aug 24 07:46:21.153854 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:46:21.153854 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:46:21.153854 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:46:21.153854 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:46:21.153854 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:46:21.153854 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:46:21.153854 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:46:21.153854 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:46:21.153854 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63a5cb56-fccf-4fbe-be10-b637c616539c could not be found. Aug 24 07:46:21.153854 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:46:21.155162 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-5f8bc3f7-0d99-41af-ac8e-2da18b4b47a7 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] Returning 404 to user: Instance 63a5cb56-fccf-4fbe-be10-b637c616539c could not be found. {{(pid=127114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:46:21.155162 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-5f8bc3f7-0d99-41af-ac8e-2da18b4b47a7 tempest-AttachVolumeTestJSON-1817292289 tempest-AttachVolumeTestJSON-1817292289-project] 10.222.0.42 "GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c" status: 404 len: 111 microversion: 2.1 time: 0.029578 Aug 24 07:46:21.155162 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 372/734] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:46:21 2022] GET /compute/v2.1/servers/63a5cb56-fccf-4fbe-be10-b637c616539c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 07:46:21.411431 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-5ff208b7-bf73-4ae5-abfc-7ade13d5a14d tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:21.412034 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-5ff208b7-bf73-4ae5-abfc-7ade13d5a14d tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 0e77f06a-967d-4e17-9254-dd0237ec8d0e] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:21.418263 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5ff208b7-bf73-4ae5-abfc-7ade13d5a14d tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:21.418764 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5ff208b7-bf73-4ae5-abfc-7ade13d5a14d tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:21.419191 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5ff208b7-bf73-4ae5-abfc-7ade13d5a14d tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:21.419879 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5ff208b7-bf73-4ae5-abfc-7ade13d5a14d tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:21.420323 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5ff208b7-bf73-4ae5-abfc-7ade13d5a14d tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:21.420738 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5ff208b7-bf73-4ae5-abfc-7ade13d5a14d tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:21.552702 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-5ff208b7-bf73-4ae5-abfc-7ade13d5a14d tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:21.560574 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-5ff208b7-bf73-4ae5-abfc-7ade13d5a14d tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/0e77f06a-967d-4e17-9254-dd0237ec8d0e" status: 200 len: 1267 microversion: 2.1 time: 0.152936 Aug 24 07:46:21.561128 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 363/735] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:46:21 2022] GET /compute/v2.1/servers/0e77f06a-967d-4e17-9254-dd0237ec8d0e => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:46:21.730613 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-88a4a897-7fca-45a7-bfa0-bc1636b1394b tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:21.731579 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-88a4a897-7fca-45a7-bfa0-bc1636b1394b tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: ac3c9f36-8b18-45dd-b610-76ffb47d5ae3] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:21.739260 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-88a4a897-7fca-45a7-bfa0-bc1636b1394b tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:21.739874 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-88a4a897-7fca-45a7-bfa0-bc1636b1394b tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:21.740424 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-88a4a897-7fca-45a7-bfa0-bc1636b1394b tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:21.741248 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-88a4a897-7fca-45a7-bfa0-bc1636b1394b tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:21.741907 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-88a4a897-7fca-45a7-bfa0-bc1636b1394b tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:21.742391 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-88a4a897-7fca-45a7-bfa0-bc1636b1394b tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:21.965511 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-88a4a897-7fca-45a7-bfa0-bc1636b1394b tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:21.973363 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-88a4a897-7fca-45a7-bfa0-bc1636b1394b tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3" status: 200 len: 1367 microversion: 2.1 time: 0.246660 Aug 24 07:46:21.973917 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 373/736] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:46:21 2022] GET /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3 => generated 1367 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:46:22.581714 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-6e50ed2b-edcb-42b4-93df-a7e6cc5f0e2c tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:22.582422 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-6e50ed2b-edcb-42b4-93df-a7e6cc5f0e2c tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 0e77f06a-967d-4e17-9254-dd0237ec8d0e] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:22.589415 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6e50ed2b-edcb-42b4-93df-a7e6cc5f0e2c tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:22.589793 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6e50ed2b-edcb-42b4-93df-a7e6cc5f0e2c tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:22.590230 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6e50ed2b-edcb-42b4-93df-a7e6cc5f0e2c tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:22.590984 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6e50ed2b-edcb-42b4-93df-a7e6cc5f0e2c tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:22.591463 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6e50ed2b-edcb-42b4-93df-a7e6cc5f0e2c tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:22.591888 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6e50ed2b-edcb-42b4-93df-a7e6cc5f0e2c tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:22.748967 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-6e50ed2b-edcb-42b4-93df-a7e6cc5f0e2c tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:22.757564 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-6e50ed2b-edcb-42b4-93df-a7e6cc5f0e2c tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/0e77f06a-967d-4e17-9254-dd0237ec8d0e" status: 200 len: 1267 microversion: 2.1 time: 0.179809 Aug 24 07:46:22.758254 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 364/737] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:46:22 2022] GET /compute/v2.1/servers/0e77f06a-967d-4e17-9254-dd0237ec8d0e => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:46:22.993560 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-8ef60c91-419d-4205-9705-288c73d807d8 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:22.994165 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-8ef60c91-419d-4205-9705-288c73d807d8 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: ac3c9f36-8b18-45dd-b610-76ffb47d5ae3] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:23.000930 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8ef60c91-419d-4205-9705-288c73d807d8 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:23.002867 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8ef60c91-419d-4205-9705-288c73d807d8 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:23.003311 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8ef60c91-419d-4205-9705-288c73d807d8 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:23.004005 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8ef60c91-419d-4205-9705-288c73d807d8 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:23.004485 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8ef60c91-419d-4205-9705-288c73d807d8 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:23.004940 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8ef60c91-419d-4205-9705-288c73d807d8 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:23.218134 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-8ef60c91-419d-4205-9705-288c73d807d8 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:23.229571 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-8ef60c91-419d-4205-9705-288c73d807d8 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3" status: 200 len: 1367 microversion: 2.1 time: 0.239847 Aug 24 07:46:23.230158 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 374/738] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:46:22 2022] GET /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3 => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:46:23.779562 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-b356a178-6c53-465f-8791-4fd2c9548fd3 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:23.780201 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-b356a178-6c53-465f-8791-4fd2c9548fd3 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 0e77f06a-967d-4e17-9254-dd0237ec8d0e] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:23.791261 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b356a178-6c53-465f-8791-4fd2c9548fd3 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:23.791936 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b356a178-6c53-465f-8791-4fd2c9548fd3 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:23.792553 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b356a178-6c53-465f-8791-4fd2c9548fd3 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:23.793298 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b356a178-6c53-465f-8791-4fd2c9548fd3 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:23.794028 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b356a178-6c53-465f-8791-4fd2c9548fd3 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:23.794537 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b356a178-6c53-465f-8791-4fd2c9548fd3 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:23.964299 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-b356a178-6c53-465f-8791-4fd2c9548fd3 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:23.972781 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-b356a178-6c53-465f-8791-4fd2c9548fd3 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/0e77f06a-967d-4e17-9254-dd0237ec8d0e" status: 200 len: 1267 microversion: 2.1 time: 0.197166 Aug 24 07:46:23.973702 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 365/739] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:46:23 2022] GET /compute/v2.1/servers/0e77f06a-967d-4e17-9254-dd0237ec8d0e => generated 1267 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:46:24.017354 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [req-f747c26d-d078-4604-9a4e-05f48f837536 req-3fc34ffb-12af-4acd-832e-f897f5507a51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e77f06a-967d-4e17-9254-dd0237ec8d0e", "name": "network-vif-plugged", "status": "completed", "tag": "93a5f212-19aa-44d9-bf70-225e89f629ea"}]} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:46:24.027880 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-f747c26d-d078-4604-9a4e-05f48f837536 req-3fc34ffb-12af-4acd-832e-f897f5507a51 service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:24.028448 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-f747c26d-d078-4604-9a4e-05f48f837536 req-3fc34ffb-12af-4acd-832e-f897f5507a51 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:24.029078 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-f747c26d-d078-4604-9a4e-05f48f837536 req-3fc34ffb-12af-4acd-832e-f897f5507a51 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:24.042634 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.compute.server_external_events [req-f747c26d-d078-4604-9a4e-05f48f837536 req-3fc34ffb-12af-4acd-832e-f897f5507a51 service nova] Creating event network-vif-plugged:93a5f212-19aa-44d9-bf70-225e89f629ea for instance 0e77f06a-967d-4e17-9254-dd0237ec8d0e on hv-cinder-85427 Aug 24 07:46:24.048342 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [req-f747c26d-d078-4604-9a4e-05f48f837536 req-3fc34ffb-12af-4acd-832e-f897f5507a51 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034739 Aug 24 07:46:24.049226 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 375/740] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:46:24.253482 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-21599da0-7db5-45de-b176-7b8ea7895e87 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:24.254101 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-21599da0-7db5-45de-b176-7b8ea7895e87 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: ac3c9f36-8b18-45dd-b610-76ffb47d5ae3] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:24.265934 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-21599da0-7db5-45de-b176-7b8ea7895e87 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:24.267605 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-21599da0-7db5-45de-b176-7b8ea7895e87 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:24.268304 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-21599da0-7db5-45de-b176-7b8ea7895e87 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:24.271323 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-21599da0-7db5-45de-b176-7b8ea7895e87 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:24.272534 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-21599da0-7db5-45de-b176-7b8ea7895e87 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:24.273753 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-21599da0-7db5-45de-b176-7b8ea7895e87 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:24.427776 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell0:SELECT=4 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:24.446977 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell0:SELECT=12 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:24.513416 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-21599da0-7db5-45de-b176-7b8ea7895e87 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:24.524199 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-21599da0-7db5-45de-b176-7b8ea7895e87 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3" status: 200 len: 1367 microversion: 2.1 time: 0.276346 Aug 24 07:46:24.525614 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 366/741] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:46:24 2022] GET /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3 => generated 1367 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:46:24.990734 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell0:SELECT=8 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:24.995093 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-47e1e033-f98f-42e8-9a34-8daf74cccd6e tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:24.995867 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-47e1e033-f98f-42e8-9a34-8daf74cccd6e tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 0e77f06a-967d-4e17-9254-dd0237ec8d0e] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:25.002820 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-47e1e033-f98f-42e8-9a34-8daf74cccd6e tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:25.003336 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-47e1e033-f98f-42e8-9a34-8daf74cccd6e tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:25.003869 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-47e1e033-f98f-42e8-9a34-8daf74cccd6e tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:25.004779 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-47e1e033-f98f-42e8-9a34-8daf74cccd6e tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:25.005242 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-47e1e033-f98f-42e8-9a34-8daf74cccd6e tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:25.005764 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-47e1e033-f98f-42e8-9a34-8daf74cccd6e tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:25.147853 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-47e1e033-f98f-42e8-9a34-8daf74cccd6e tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:25.155404 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-47e1e033-f98f-42e8-9a34-8daf74cccd6e tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/0e77f06a-967d-4e17-9254-dd0237ec8d0e" status: 200 len: 1267 microversion: 2.1 time: 0.165663 Aug 24 07:46:25.155960 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 376/742] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:46:24 2022] GET /compute/v2.1/servers/0e77f06a-967d-4e17-9254-dd0237ec8d0e => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:46:25.550135 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-3db4db58-673a-411d-b6f8-739978434f4c tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:25.550769 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-3db4db58-673a-411d-b6f8-739978434f4c tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: ac3c9f36-8b18-45dd-b610-76ffb47d5ae3] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:25.557183 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3db4db58-673a-411d-b6f8-739978434f4c tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:25.557657 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3db4db58-673a-411d-b6f8-739978434f4c tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:25.558084 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3db4db58-673a-411d-b6f8-739978434f4c tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:25.558792 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3db4db58-673a-411d-b6f8-739978434f4c tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:25.559239 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3db4db58-673a-411d-b6f8-739978434f4c tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:25.559651 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3db4db58-673a-411d-b6f8-739978434f4c tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:25.696325 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-3db4db58-673a-411d-b6f8-739978434f4c tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:25.703913 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-3db4db58-673a-411d-b6f8-739978434f4c tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3" status: 200 len: 1367 microversion: 2.1 time: 0.158384 Aug 24 07:46:25.704466 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 367/743] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:46:25 2022] GET /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:46:26.070454 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [req-e9bba6db-7717-435f-bc96-916a3b0cfec7 req-7ee6780c-c179-4fb2-96ed-b8904c6f9a2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac3c9f36-8b18-45dd-b610-76ffb47d5ae3", "name": "network-vif-plugged", "status": "completed", "tag": "17a47887-5c6a-4b79-966d-dadcb55f1b9c"}]} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:46:26.079617 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-e9bba6db-7717-435f-bc96-916a3b0cfec7 req-7ee6780c-c179-4fb2-96ed-b8904c6f9a2c service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:26.080089 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-e9bba6db-7717-435f-bc96-916a3b0cfec7 req-7ee6780c-c179-4fb2-96ed-b8904c6f9a2c service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:26.080512 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-e9bba6db-7717-435f-bc96-916a3b0cfec7 req-7ee6780c-c179-4fb2-96ed-b8904c6f9a2c service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:26.092201 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.compute.server_external_events [req-e9bba6db-7717-435f-bc96-916a3b0cfec7 req-7ee6780c-c179-4fb2-96ed-b8904c6f9a2c service nova] Creating event network-vif-plugged:17a47887-5c6a-4b79-966d-dadcb55f1b9c for instance ac3c9f36-8b18-45dd-b610-76ffb47d5ae3 on hv-cinder-85427 Aug 24 07:46:26.097930 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [req-e9bba6db-7717-435f-bc96-916a3b0cfec7 req-7ee6780c-c179-4fb2-96ed-b8904c6f9a2c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033245 Aug 24 07:46:26.098596 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 377/744] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:46:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:46:26.176421 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-fbb95bb2-978d-4d1d-80c3-08b3d226fff4 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:26.177320 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-fbb95bb2-978d-4d1d-80c3-08b3d226fff4 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 0e77f06a-967d-4e17-9254-dd0237ec8d0e] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:26.183306 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-fbb95bb2-978d-4d1d-80c3-08b3d226fff4 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:26.183785 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-fbb95bb2-978d-4d1d-80c3-08b3d226fff4 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:26.184269 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-fbb95bb2-978d-4d1d-80c3-08b3d226fff4 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:26.184863 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-fbb95bb2-978d-4d1d-80c3-08b3d226fff4 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:26.185292 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-fbb95bb2-978d-4d1d-80c3-08b3d226fff4 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:26.185889 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-fbb95bb2-978d-4d1d-80c3-08b3d226fff4 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:26.321671 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-fbb95bb2-978d-4d1d-80c3-08b3d226fff4 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:26.330805 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-fbb95bb2-978d-4d1d-80c3-08b3d226fff4 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/0e77f06a-967d-4e17-9254-dd0237ec8d0e" status: 200 len: 1453 microversion: 2.1 time: 0.158749 Aug 24 07:46:26.331347 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 368/745] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:46:26 2022] GET /compute/v2.1/servers/0e77f06a-967d-4e17-9254-dd0237ec8d0e => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:46:26.351304 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-c7a082cb-69fd-4ae7-83df-af8381182c06 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:26.352086 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-c7a082cb-69fd-4ae7-83df-af8381182c06 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 0e77f06a-967d-4e17-9254-dd0237ec8d0e] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:26.358064 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c7a082cb-69fd-4ae7-83df-af8381182c06 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:26.358607 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c7a082cb-69fd-4ae7-83df-af8381182c06 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:26.359134 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c7a082cb-69fd-4ae7-83df-af8381182c06 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:26.359924 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c7a082cb-69fd-4ae7-83df-af8381182c06 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:26.360536 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c7a082cb-69fd-4ae7-83df-af8381182c06 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:26.361015 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c7a082cb-69fd-4ae7-83df-af8381182c06 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:26.493398 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-c7a082cb-69fd-4ae7-83df-af8381182c06 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:26.501698 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-c7a082cb-69fd-4ae7-83df-af8381182c06 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/0e77f06a-967d-4e17-9254-dd0237ec8d0e" status: 200 len: 1453 microversion: 2.1 time: 0.154670 Aug 24 07:46:26.502259 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 378/746] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:46:26 2022] GET /compute/v2.1/servers/0e77f06a-967d-4e17-9254-dd0237ec8d0e => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:46:26.730850 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-17fb915f-9be2-4de9-b26e-ea0c53d2bfbb tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:26.731710 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-17fb915f-9be2-4de9-b26e-ea0c53d2bfbb tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: ac3c9f36-8b18-45dd-b610-76ffb47d5ae3] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:26.739220 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-17fb915f-9be2-4de9-b26e-ea0c53d2bfbb tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:26.739835 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-17fb915f-9be2-4de9-b26e-ea0c53d2bfbb tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:26.740128 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-17fb915f-9be2-4de9-b26e-ea0c53d2bfbb tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:26.740821 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-17fb915f-9be2-4de9-b26e-ea0c53d2bfbb tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:26.741270 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-17fb915f-9be2-4de9-b26e-ea0c53d2bfbb tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:26.741691 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-17fb915f-9be2-4de9-b26e-ea0c53d2bfbb tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:26.892150 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-17fb915f-9be2-4de9-b26e-ea0c53d2bfbb tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:26.899976 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-17fb915f-9be2-4de9-b26e-ea0c53d2bfbb tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3" status: 200 len: 1367 microversion: 2.1 time: 0.179496 Aug 24 07:46:26.900544 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 369/747] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:46:26 2022] GET /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:46:27.407980 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-c24f4da5-ebb0-45b0-b45e-93a88b1459df tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:27.408477 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-c24f4da5-ebb0-45b0-b45e-93a88b1459df tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:27.414280 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c24f4da5-ebb0-45b0-b45e-93a88b1459df tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:27.414785 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c24f4da5-ebb0-45b0-b45e-93a88b1459df tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:27.415216 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c24f4da5-ebb0-45b0-b45e-93a88b1459df tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:27.415904 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c24f4da5-ebb0-45b0-b45e-93a88b1459df tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:27.416363 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c24f4da5-ebb0-45b0-b45e-93a88b1459df tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:27.416777 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c24f4da5-ebb0-45b0-b45e-93a88b1459df tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:27.448147 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-c24f4da5-ebb0-45b0-b45e-93a88b1459df tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651/ips" status: 200 len: 152 microversion: 2.20 time: 0.042708 Aug 24 07:46:27.454954 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 379/748] 10.222.0.42 () {60 vars in 1289 bytes} [Wed Aug 24 07:46:27 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651/ips => generated 152 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 07:46:27.921318 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-c6ce6b05-d1c8-48cb-9572-4fe5e0e48e62 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:27.921931 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-c6ce6b05-d1c8-48cb-9572-4fe5e0e48e62 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: ac3c9f36-8b18-45dd-b610-76ffb47d5ae3] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:27.929417 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c6ce6b05-d1c8-48cb-9572-4fe5e0e48e62 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:27.930156 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c6ce6b05-d1c8-48cb-9572-4fe5e0e48e62 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:27.930827 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c6ce6b05-d1c8-48cb-9572-4fe5e0e48e62 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:27.931511 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c6ce6b05-d1c8-48cb-9572-4fe5e0e48e62 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:27.931966 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c6ce6b05-d1c8-48cb-9572-4fe5e0e48e62 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:27.932376 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c6ce6b05-d1c8-48cb-9572-4fe5e0e48e62 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:28.170410 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [req-eaaa49a0-27dd-4a69-ab16-f7bccfd84b1a req-fac3221e-d133-41fe-9cb3-b434f626414c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e77f06a-967d-4e17-9254-dd0237ec8d0e", "tag": "93a5f212-19aa-44d9-bf70-225e89f629ea"}]} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:46:28.181079 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-eaaa49a0-27dd-4a69-ab16-f7bccfd84b1a req-fac3221e-d133-41fe-9cb3-b434f626414c service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:28.181648 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-eaaa49a0-27dd-4a69-ab16-f7bccfd84b1a req-fac3221e-d133-41fe-9cb3-b434f626414c service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:28.182140 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-eaaa49a0-27dd-4a69-ab16-f7bccfd84b1a req-fac3221e-d133-41fe-9cb3-b434f626414c service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:28.193338 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.compute.server_external_events [req-eaaa49a0-27dd-4a69-ab16-f7bccfd84b1a req-fac3221e-d133-41fe-9cb3-b434f626414c service nova] Creating event network-changed:93a5f212-19aa-44d9-bf70-225e89f629ea for instance 0e77f06a-967d-4e17-9254-dd0237ec8d0e on hv-cinder-85427 Aug 24 07:46:28.200291 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [req-eaaa49a0-27dd-4a69-ab16-f7bccfd84b1a req-fac3221e-d133-41fe-9cb3-b434f626414c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033476 Aug 24 07:46:28.200886 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 380/749] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:46:28.248644 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-c6ce6b05-d1c8-48cb-9572-4fe5e0e48e62 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:28.257299 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-c6ce6b05-d1c8-48cb-9572-4fe5e0e48e62 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3" status: 200 len: 1557 microversion: 2.1 time: 0.339740 Aug 24 07:46:28.258029 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 370/750] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:46:27 2022] GET /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3 => generated 1557 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:46:28.279466 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-f895893c-e196-4d46-948e-b06e0afbee20 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:28.280145 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-f895893c-e196-4d46-948e-b06e0afbee20 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: ac3c9f36-8b18-45dd-b610-76ffb47d5ae3] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:28.287677 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f895893c-e196-4d46-948e-b06e0afbee20 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:28.288242 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f895893c-e196-4d46-948e-b06e0afbee20 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:28.288746 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f895893c-e196-4d46-948e-b06e0afbee20 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:28.289690 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f895893c-e196-4d46-948e-b06e0afbee20 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:28.290208 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f895893c-e196-4d46-948e-b06e0afbee20 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:28.290722 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f895893c-e196-4d46-948e-b06e0afbee20 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:28.403280 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-f895893c-e196-4d46-948e-b06e0afbee20 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.128407 Aug 24 07:46:28.403895 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 381/751] 10.222.0.42 () {58 vars in 1275 bytes} [Wed Aug 24 07:46:28 2022] GET /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3/os-interface => generated 284 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:46:29.347243 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-7bb8c23a-d457-4fb8-932c-1e0368883acf tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:46:29.347985 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-7bb8c23a-d457-4fb8-932c-1e0368883acf tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:29.354433 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7bb8c23a-d457-4fb8-932c-1e0368883acf tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:29.355172 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7bb8c23a-d457-4fb8-932c-1e0368883acf tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:29.355775 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7bb8c23a-d457-4fb8-932c-1e0368883acf tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:29.356458 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7bb8c23a-d457-4fb8-932c-1e0368883acf tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:29.357404 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7bb8c23a-d457-4fb8-932c-1e0368883acf tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:29.358053 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7bb8c23a-d457-4fb8-932c-1e0368883acf tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:29.385753 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.objects.instance [None req-7bb8c23a-d457-4fb8-932c-1e0368883acf tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lazy-loading 'flavor' on Instance uuid a80b309c-fa06-43b7-be57-1dc3045b9651 {{(pid=127113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:46:29.460473 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:29.577151 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-7bb8c23a-d457-4fb8-932c-1e0368883acf tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "POST /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651/action" status: 202 len: 0 microversion: 2.20 time: 0.234711 Aug 24 07:46:29.577927 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 371/752] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 24 07:46:29 2022] POST /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 24 07:46:29.587152 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-8c1a1195-b3ff-4c2f-b336-c467fdd135bd tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:29.587748 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-8c1a1195-b3ff-4c2f-b336-c467fdd135bd tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:29.595013 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8c1a1195-b3ff-4c2f-b336-c467fdd135bd tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:29.595488 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8c1a1195-b3ff-4c2f-b336-c467fdd135bd tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:29.595916 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8c1a1195-b3ff-4c2f-b336-c467fdd135bd tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:29.596630 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8c1a1195-b3ff-4c2f-b336-c467fdd135bd tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:29.597072 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8c1a1195-b3ff-4c2f-b336-c467fdd135bd tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:29.597481 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8c1a1195-b3ff-4c2f-b336-c467fdd135bd tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:29.736988 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-8c1a1195-b3ff-4c2f-b336-c467fdd135bd tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:29.739285 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell1:SELECT=100 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:29.746952 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-8c1a1195-b3ff-4c2f-b336-c467fdd135bd tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:29.748529 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-8c1a1195-b3ff-4c2f-b336-c467fdd135bd tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:29.749672 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-8c1a1195-b3ff-4c2f-b336-c467fdd135bd tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1724 microversion: 2.20 time: 0.167120 Aug 24 07:46:29.750293 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 382/753] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:46:29 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:46:30.215723 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [req-01c917cd-1d27-4987-bf68-82c1d0c06093 req-55fb92f1-a1c1-4c3d-af8f-d6fe24bbb8cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac3c9f36-8b18-45dd-b610-76ffb47d5ae3", "tag": "17a47887-5c6a-4b79-966d-dadcb55f1b9c"}]} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:46:30.225184 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-01c917cd-1d27-4987-bf68-82c1d0c06093 req-55fb92f1-a1c1-4c3d-af8f-d6fe24bbb8cc service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:30.225658 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-01c917cd-1d27-4987-bf68-82c1d0c06093 req-55fb92f1-a1c1-4c3d-af8f-d6fe24bbb8cc service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:30.226088 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-01c917cd-1d27-4987-bf68-82c1d0c06093 req-55fb92f1-a1c1-4c3d-af8f-d6fe24bbb8cc service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:30.236935 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.compute.server_external_events [req-01c917cd-1d27-4987-bf68-82c1d0c06093 req-55fb92f1-a1c1-4c3d-af8f-d6fe24bbb8cc service nova] Creating event network-changed:17a47887-5c6a-4b79-966d-dadcb55f1b9c for instance ac3c9f36-8b18-45dd-b610-76ffb47d5ae3 on hv-cinder-85427 Aug 24 07:46:30.241701 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [req-01c917cd-1d27-4987-bf68-82c1d0c06093 req-55fb92f1-a1c1-4c3d-af8f-d6fe24bbb8cc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030050 Aug 24 07:46:30.242287 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 372/754] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:46:30.771773 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-fdc684ef-81fb-4319-a69d-5d9f2174c1c5 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:30.772311 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-fdc684ef-81fb-4319-a69d-5d9f2174c1c5 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:30.778773 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fdc684ef-81fb-4319-a69d-5d9f2174c1c5 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:30.779250 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fdc684ef-81fb-4319-a69d-5d9f2174c1c5 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:30.779680 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fdc684ef-81fb-4319-a69d-5d9f2174c1c5 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:30.780360 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fdc684ef-81fb-4319-a69d-5d9f2174c1c5 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:30.780809 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fdc684ef-81fb-4319-a69d-5d9f2174c1c5 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:30.781260 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fdc684ef-81fb-4319-a69d-5d9f2174c1c5 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:30.939085 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-fdc684ef-81fb-4319-a69d-5d9f2174c1c5 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:30.947100 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-fdc684ef-81fb-4319-a69d-5d9f2174c1c5 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:30.948628 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-fdc684ef-81fb-4319-a69d-5d9f2174c1c5 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:30.949801 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-fdc684ef-81fb-4319-a69d-5d9f2174c1c5 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1724 microversion: 2.20 time: 0.181928 Aug 24 07:46:30.950354 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 383/755] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:46:30 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 07:46:31.972693 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-6c816928-e96d-4b45-8ce8-0de74621b931 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:31.973405 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-6c816928-e96d-4b45-8ce8-0de74621b931 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:31.979508 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6c816928-e96d-4b45-8ce8-0de74621b931 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:31.979981 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6c816928-e96d-4b45-8ce8-0de74621b931 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:31.980405 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6c816928-e96d-4b45-8ce8-0de74621b931 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:31.981078 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6c816928-e96d-4b45-8ce8-0de74621b931 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:31.981528 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6c816928-e96d-4b45-8ce8-0de74621b931 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:31.981942 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6c816928-e96d-4b45-8ce8-0de74621b931 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:32.113043 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-6c816928-e96d-4b45-8ce8-0de74621b931 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:32.121061 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-6c816928-e96d-4b45-8ce8-0de74621b931 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:32.122554 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-6c816928-e96d-4b45-8ce8-0de74621b931 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:32.123724 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-6c816928-e96d-4b45-8ce8-0de74621b931 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1724 microversion: 2.20 time: 0.155769 Aug 24 07:46:32.124283 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 373/756] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:46:31 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:46:33.147502 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-31d665a8-b07a-4a13-afb7-3b618c3e258e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:33.148101 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-31d665a8-b07a-4a13-afb7-3b618c3e258e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:33.154549 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-31d665a8-b07a-4a13-afb7-3b618c3e258e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:33.155051 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-31d665a8-b07a-4a13-afb7-3b618c3e258e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:33.155475 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-31d665a8-b07a-4a13-afb7-3b618c3e258e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:33.156148 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-31d665a8-b07a-4a13-afb7-3b618c3e258e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:33.156590 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-31d665a8-b07a-4a13-afb7-3b618c3e258e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:33.157006 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-31d665a8-b07a-4a13-afb7-3b618c3e258e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:33.287951 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-31d665a8-b07a-4a13-afb7-3b618c3e258e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:33.295977 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-31d665a8-b07a-4a13-afb7-3b618c3e258e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:33.297520 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-31d665a8-b07a-4a13-afb7-3b618c3e258e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:33.298955 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-31d665a8-b07a-4a13-afb7-3b618c3e258e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1724 microversion: 2.20 time: 0.155289 Aug 24 07:46:33.299533 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 384/757] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:46:33 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:46:34.321383 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-004bc7c6-8c4b-45b3-b69b-56f76c07ed75 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:34.321974 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-004bc7c6-8c4b-45b3-b69b-56f76c07ed75 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:34.328878 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-004bc7c6-8c4b-45b3-b69b-56f76c07ed75 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:34.329346 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-004bc7c6-8c4b-45b3-b69b-56f76c07ed75 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:34.329769 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-004bc7c6-8c4b-45b3-b69b-56f76c07ed75 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:34.330439 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-004bc7c6-8c4b-45b3-b69b-56f76c07ed75 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:34.330908 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-004bc7c6-8c4b-45b3-b69b-56f76c07ed75 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:34.331320 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-004bc7c6-8c4b-45b3-b69b-56f76c07ed75 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:34.456656 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-004bc7c6-8c4b-45b3-b69b-56f76c07ed75 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:34.464773 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-004bc7c6-8c4b-45b3-b69b-56f76c07ed75 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:34.466291 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-004bc7c6-8c4b-45b3-b69b-56f76c07ed75 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:34.467460 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-004bc7c6-8c4b-45b3-b69b-56f76c07ed75 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1724 microversion: 2.20 time: 0.149961 Aug 24 07:46:34.468035 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 374/758] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:46:34 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:46:35.490936 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-cc1ffd47-ac9b-43dc-a5d8-d32c752bc7d0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:35.491536 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-cc1ffd47-ac9b-43dc-a5d8-d32c752bc7d0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:35.498090 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cc1ffd47-ac9b-43dc-a5d8-d32c752bc7d0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:35.498558 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cc1ffd47-ac9b-43dc-a5d8-d32c752bc7d0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:35.499015 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cc1ffd47-ac9b-43dc-a5d8-d32c752bc7d0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:35.499690 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cc1ffd47-ac9b-43dc-a5d8-d32c752bc7d0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:35.500164 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cc1ffd47-ac9b-43dc-a5d8-d32c752bc7d0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:35.500582 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cc1ffd47-ac9b-43dc-a5d8-d32c752bc7d0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:35.627251 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-cc1ffd47-ac9b-43dc-a5d8-d32c752bc7d0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:35.635496 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-cc1ffd47-ac9b-43dc-a5d8-d32c752bc7d0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:35.636995 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-cc1ffd47-ac9b-43dc-a5d8-d32c752bc7d0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:35.638136 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-cc1ffd47-ac9b-43dc-a5d8-d32c752bc7d0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1724 microversion: 2.20 time: 0.151136 Aug 24 07:46:35.638926 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 385/759] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:46:35 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 07:46:36.660480 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-b48da1e4-5fcd-405e-bd52-ddc3bcc70f02 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:36.661082 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-b48da1e4-5fcd-405e-bd52-ddc3bcc70f02 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:36.667558 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b48da1e4-5fcd-405e-bd52-ddc3bcc70f02 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:36.668027 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b48da1e4-5fcd-405e-bd52-ddc3bcc70f02 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:36.668454 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b48da1e4-5fcd-405e-bd52-ddc3bcc70f02 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:36.669132 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b48da1e4-5fcd-405e-bd52-ddc3bcc70f02 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:36.669578 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b48da1e4-5fcd-405e-bd52-ddc3bcc70f02 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:36.669994 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b48da1e4-5fcd-405e-bd52-ddc3bcc70f02 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:36.795483 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-b48da1e4-5fcd-405e-bd52-ddc3bcc70f02 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:36.804269 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-b48da1e4-5fcd-405e-bd52-ddc3bcc70f02 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:36.805754 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-b48da1e4-5fcd-405e-bd52-ddc3bcc70f02 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:36.806914 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-b48da1e4-5fcd-405e-bd52-ddc3bcc70f02 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1724 microversion: 2.20 time: 0.150332 Aug 24 07:46:36.807464 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 375/760] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:46:36 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:46:37.829531 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-4f110209-6e91-444e-a86a-824a725f7c8f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:37.830038 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-4f110209-6e91-444e-a86a-824a725f7c8f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:37.832384 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:37.837756 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4f110209-6e91-444e-a86a-824a725f7c8f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:37.838226 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4f110209-6e91-444e-a86a-824a725f7c8f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:37.838651 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4f110209-6e91-444e-a86a-824a725f7c8f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:37.839349 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4f110209-6e91-444e-a86a-824a725f7c8f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:37.839793 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4f110209-6e91-444e-a86a-824a725f7c8f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:37.840204 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4f110209-6e91-444e-a86a-824a725f7c8f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:37.974994 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-4f110209-6e91-444e-a86a-824a725f7c8f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:37.983080 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-4f110209-6e91-444e-a86a-824a725f7c8f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:37.984574 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-4f110209-6e91-444e-a86a-824a725f7c8f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:37.985717 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-4f110209-6e91-444e-a86a-824a725f7c8f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1724 microversion: 2.20 time: 0.160158 Aug 24 07:46:37.986272 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 386/761] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:46:37 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:46:39.007789 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-ff6df280-9b8a-4170-b0bc-9ec12f5c0782 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:39.008395 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-ff6df280-9b8a-4170-b0bc-9ec12f5c0782 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:39.010810 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:46:39.017174 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ff6df280-9b8a-4170-b0bc-9ec12f5c0782 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:39.017648 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ff6df280-9b8a-4170-b0bc-9ec12f5c0782 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:39.018073 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ff6df280-9b8a-4170-b0bc-9ec12f5c0782 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:39.018806 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ff6df280-9b8a-4170-b0bc-9ec12f5c0782 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:39.019291 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ff6df280-9b8a-4170-b0bc-9ec12f5c0782 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:39.019765 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ff6df280-9b8a-4170-b0bc-9ec12f5c0782 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:39.151075 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-ff6df280-9b8a-4170-b0bc-9ec12f5c0782 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:39.159747 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-ff6df280-9b8a-4170-b0bc-9ec12f5c0782 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:39.161270 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-ff6df280-9b8a-4170-b0bc-9ec12f5c0782 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:39.162436 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-ff6df280-9b8a-4170-b0bc-9ec12f5c0782 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1724 microversion: 2.20 time: 0.158657 Aug 24 07:46:39.163004 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 376/762] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:46:39 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:46:40.185628 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-6a84d057-bf0e-4307-bf23-88ff7a427562 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:40.186227 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-6a84d057-bf0e-4307-bf23-88ff7a427562 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:40.193343 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6a84d057-bf0e-4307-bf23-88ff7a427562 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:40.193820 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6a84d057-bf0e-4307-bf23-88ff7a427562 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:40.194250 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6a84d057-bf0e-4307-bf23-88ff7a427562 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:40.194970 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6a84d057-bf0e-4307-bf23-88ff7a427562 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:40.195424 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6a84d057-bf0e-4307-bf23-88ff7a427562 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:40.195840 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6a84d057-bf0e-4307-bf23-88ff7a427562 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:40.325346 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-6a84d057-bf0e-4307-bf23-88ff7a427562 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:40.333981 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-6a84d057-bf0e-4307-bf23-88ff7a427562 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:40.336712 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-6a84d057-bf0e-4307-bf23-88ff7a427562 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:40.337870 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-6a84d057-bf0e-4307-bf23-88ff7a427562 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1724 microversion: 2.20 time: 0.156092 Aug 24 07:46:40.338416 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 387/763] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:46:40 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:46:41.360972 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-09aaa523-b0b5-4ec1-b5c9-81c37b393b8b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:41.361532 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-09aaa523-b0b5-4ec1-b5c9-81c37b393b8b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:41.368276 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-09aaa523-b0b5-4ec1-b5c9-81c37b393b8b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:41.368749 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-09aaa523-b0b5-4ec1-b5c9-81c37b393b8b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:41.369178 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-09aaa523-b0b5-4ec1-b5c9-81c37b393b8b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:41.369865 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-09aaa523-b0b5-4ec1-b5c9-81c37b393b8b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:41.370312 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-09aaa523-b0b5-4ec1-b5c9-81c37b393b8b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:41.373734 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-09aaa523-b0b5-4ec1-b5c9-81c37b393b8b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:41.502939 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-09aaa523-b0b5-4ec1-b5c9-81c37b393b8b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:41.511414 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-09aaa523-b0b5-4ec1-b5c9-81c37b393b8b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:41.512908 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-09aaa523-b0b5-4ec1-b5c9-81c37b393b8b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:41.514059 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-09aaa523-b0b5-4ec1-b5c9-81c37b393b8b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1724 microversion: 2.20 time: 0.157560 Aug 24 07:46:41.514613 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 377/764] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:46:41 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:46:42.538214 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-5550893e-aa67-461c-8972-9012dec172df tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:42.538847 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-5550893e-aa67-461c-8972-9012dec172df tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:42.545223 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5550893e-aa67-461c-8972-9012dec172df tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:42.545703 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5550893e-aa67-461c-8972-9012dec172df tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:42.546137 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5550893e-aa67-461c-8972-9012dec172df tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:42.546851 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5550893e-aa67-461c-8972-9012dec172df tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:42.547805 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5550893e-aa67-461c-8972-9012dec172df tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:42.548827 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5550893e-aa67-461c-8972-9012dec172df tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:42.678531 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-5550893e-aa67-461c-8972-9012dec172df tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:42.686518 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-5550893e-aa67-461c-8972-9012dec172df tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:42.688716 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-5550893e-aa67-461c-8972-9012dec172df tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:42.689864 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-5550893e-aa67-461c-8972-9012dec172df tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1724 microversion: 2.20 time: 0.155512 Aug 24 07:46:42.690428 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 388/765] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:46:42 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:46:43.711523 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-8dece60e-23b7-4ba5-92c9-037e4e113bcb tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:43.712119 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-8dece60e-23b7-4ba5-92c9-037e4e113bcb tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:43.718409 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8dece60e-23b7-4ba5-92c9-037e4e113bcb tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:43.719203 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8dece60e-23b7-4ba5-92c9-037e4e113bcb tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:43.719633 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8dece60e-23b7-4ba5-92c9-037e4e113bcb tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:43.720313 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8dece60e-23b7-4ba5-92c9-037e4e113bcb tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:43.720780 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8dece60e-23b7-4ba5-92c9-037e4e113bcb tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:43.721192 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8dece60e-23b7-4ba5-92c9-037e4e113bcb tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:43.850582 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-8dece60e-23b7-4ba5-92c9-037e4e113bcb tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:43.858688 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-8dece60e-23b7-4ba5-92c9-037e4e113bcb tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:43.860219 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-8dece60e-23b7-4ba5-92c9-037e4e113bcb tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:43.861366 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-8dece60e-23b7-4ba5-92c9-037e4e113bcb tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1724 microversion: 2.20 time: 0.153717 Aug 24 07:46:43.861919 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 378/766] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:46:43 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:46:44.884307 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-7dd409a7-c236-4d25-84a1-e56592295ab5 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:44.884900 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-7dd409a7-c236-4d25-84a1-e56592295ab5 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:44.891258 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7dd409a7-c236-4d25-84a1-e56592295ab5 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:44.891748 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7dd409a7-c236-4d25-84a1-e56592295ab5 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:44.892155 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7dd409a7-c236-4d25-84a1-e56592295ab5 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:44.892844 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7dd409a7-c236-4d25-84a1-e56592295ab5 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:44.893299 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7dd409a7-c236-4d25-84a1-e56592295ab5 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:44.893711 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7dd409a7-c236-4d25-84a1-e56592295ab5 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:45.023117 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-7dd409a7-c236-4d25-84a1-e56592295ab5 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:45.031353 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-7dd409a7-c236-4d25-84a1-e56592295ab5 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:45.033430 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-7dd409a7-c236-4d25-84a1-e56592295ab5 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:45.034591 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-7dd409a7-c236-4d25-84a1-e56592295ab5 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1724 microversion: 2.20 time: 0.154187 Aug 24 07:46:45.035190 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 389/767] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:46:44 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:46:46.057782 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-bd59dc83-d787-44a2-8b84-3975ebdc8264 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:46.058321 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-bd59dc83-d787-44a2-8b84-3975ebdc8264 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:46.064765 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bd59dc83-d787-44a2-8b84-3975ebdc8264 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:46.065234 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bd59dc83-d787-44a2-8b84-3975ebdc8264 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:46.065660 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bd59dc83-d787-44a2-8b84-3975ebdc8264 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:46.066331 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bd59dc83-d787-44a2-8b84-3975ebdc8264 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:46.066792 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bd59dc83-d787-44a2-8b84-3975ebdc8264 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:46.067213 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bd59dc83-d787-44a2-8b84-3975ebdc8264 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:46.194530 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-bd59dc83-d787-44a2-8b84-3975ebdc8264 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:46.202489 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-bd59dc83-d787-44a2-8b84-3975ebdc8264 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:46.204550 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-bd59dc83-d787-44a2-8b84-3975ebdc8264 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:46.205686 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-bd59dc83-d787-44a2-8b84-3975ebdc8264 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1724 microversion: 2.20 time: 0.151932 Aug 24 07:46:46.206229 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 379/768] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:46:46 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:46:47.228429 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-e9401bb2-867d-4585-a26b-18e26f0685e8 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:47.229135 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-e9401bb2-867d-4585-a26b-18e26f0685e8 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:47.236050 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e9401bb2-867d-4585-a26b-18e26f0685e8 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:47.236602 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e9401bb2-867d-4585-a26b-18e26f0685e8 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:47.237103 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e9401bb2-867d-4585-a26b-18e26f0685e8 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:47.237850 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e9401bb2-867d-4585-a26b-18e26f0685e8 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:47.238373 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e9401bb2-867d-4585-a26b-18e26f0685e8 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:47.238890 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e9401bb2-867d-4585-a26b-18e26f0685e8 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:47.369836 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-e9401bb2-867d-4585-a26b-18e26f0685e8 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:47.381269 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-e9401bb2-867d-4585-a26b-18e26f0685e8 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:47.383368 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-e9401bb2-867d-4585-a26b-18e26f0685e8 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:47.384646 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-e9401bb2-867d-4585-a26b-18e26f0685e8 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1745 microversion: 2.20 time: 0.160178 Aug 24 07:46:47.385282 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 390/769] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:46:47 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:46:48.408160 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-35606fcb-fd21-4622-88f1-d395771dd997 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:48.408766 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-35606fcb-fd21-4622-88f1-d395771dd997 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:48.415313 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-35606fcb-fd21-4622-88f1-d395771dd997 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:48.415735 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-35606fcb-fd21-4622-88f1-d395771dd997 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:48.416167 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-35606fcb-fd21-4622-88f1-d395771dd997 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:48.416851 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-35606fcb-fd21-4622-88f1-d395771dd997 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:48.417300 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-35606fcb-fd21-4622-88f1-d395771dd997 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:48.417716 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-35606fcb-fd21-4622-88f1-d395771dd997 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:48.541534 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-35606fcb-fd21-4622-88f1-d395771dd997 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:48.550303 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-35606fcb-fd21-4622-88f1-d395771dd997 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:48.551817 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-35606fcb-fd21-4622-88f1-d395771dd997 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:48.552950 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-35606fcb-fd21-4622-88f1-d395771dd997 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1745 microversion: 2.20 time: 0.148692 Aug 24 07:46:48.553493 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 380/770] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:46:48 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1745 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:46:49.576527 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-645cc9c7-b4b0-4087-ac50-9990fc208238 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:49.577055 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-645cc9c7-b4b0-4087-ac50-9990fc208238 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:49.584387 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-645cc9c7-b4b0-4087-ac50-9990fc208238 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:49.584871 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-645cc9c7-b4b0-4087-ac50-9990fc208238 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:49.585300 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-645cc9c7-b4b0-4087-ac50-9990fc208238 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:49.585984 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-645cc9c7-b4b0-4087-ac50-9990fc208238 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:49.586427 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-645cc9c7-b4b0-4087-ac50-9990fc208238 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:49.586871 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-645cc9c7-b4b0-4087-ac50-9990fc208238 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:49.714616 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-645cc9c7-b4b0-4087-ac50-9990fc208238 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:49.722892 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-645cc9c7-b4b0-4087-ac50-9990fc208238 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:49.724394 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-645cc9c7-b4b0-4087-ac50-9990fc208238 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:49.725535 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-645cc9c7-b4b0-4087-ac50-9990fc208238 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1745 microversion: 2.20 time: 0.152988 Aug 24 07:46:49.726094 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 391/771] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:46:49 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:46:50.747244 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-9e44d50c-a749-4b9b-adb3-dfa7fcafecc5 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:50.747843 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-9e44d50c-a749-4b9b-adb3-dfa7fcafecc5 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:50.754750 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9e44d50c-a749-4b9b-adb3-dfa7fcafecc5 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:50.755225 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9e44d50c-a749-4b9b-adb3-dfa7fcafecc5 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:50.755648 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9e44d50c-a749-4b9b-adb3-dfa7fcafecc5 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:50.756322 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9e44d50c-a749-4b9b-adb3-dfa7fcafecc5 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:50.756763 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9e44d50c-a749-4b9b-adb3-dfa7fcafecc5 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:50.757173 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9e44d50c-a749-4b9b-adb3-dfa7fcafecc5 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:50.887324 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-9e44d50c-a749-4b9b-adb3-dfa7fcafecc5 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:50.895368 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-9e44d50c-a749-4b9b-adb3-dfa7fcafecc5 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:50.896916 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-9e44d50c-a749-4b9b-adb3-dfa7fcafecc5 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:50.897983 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-9e44d50c-a749-4b9b-adb3-dfa7fcafecc5 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1745 microversion: 2.20 time: 0.154619 Aug 24 07:46:50.898528 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 381/772] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:46:50 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:46:51.920410 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-4e23fd5e-4eee-4944-ac4a-eeb28af0e786 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:51.921005 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-4e23fd5e-4eee-4944-ac4a-eeb28af0e786 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:51.927901 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4e23fd5e-4eee-4944-ac4a-eeb28af0e786 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:51.928376 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4e23fd5e-4eee-4944-ac4a-eeb28af0e786 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:51.928890 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4e23fd5e-4eee-4944-ac4a-eeb28af0e786 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:51.929465 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4e23fd5e-4eee-4944-ac4a-eeb28af0e786 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:51.929997 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4e23fd5e-4eee-4944-ac4a-eeb28af0e786 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:51.930312 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4e23fd5e-4eee-4944-ac4a-eeb28af0e786 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:52.090255 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-4e23fd5e-4eee-4944-ac4a-eeb28af0e786 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:52.099394 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-4e23fd5e-4eee-4944-ac4a-eeb28af0e786 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:52.100932 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-4e23fd5e-4eee-4944-ac4a-eeb28af0e786 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:52.102115 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-4e23fd5e-4eee-4944-ac4a-eeb28af0e786 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1740 microversion: 2.20 time: 0.185735 Aug 24 07:46:52.103247 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 392/773] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:46:51 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1740 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:46:53.126827 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-b6d729b7-ef24-4467-9bce-0dca77c54cf0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:53.128191 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-b6d729b7-ef24-4467-9bce-0dca77c54cf0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:53.136103 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b6d729b7-ef24-4467-9bce-0dca77c54cf0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:53.136990 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b6d729b7-ef24-4467-9bce-0dca77c54cf0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:53.137715 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b6d729b7-ef24-4467-9bce-0dca77c54cf0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:53.138622 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b6d729b7-ef24-4467-9bce-0dca77c54cf0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:53.139301 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b6d729b7-ef24-4467-9bce-0dca77c54cf0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:53.139950 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b6d729b7-ef24-4467-9bce-0dca77c54cf0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:53.306410 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [req-fba996cf-044f-42f3-9380-0cdef03f31ab req-30ef1303-9b0f-4a11-8cd5-e0ae44deac74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a80b309c-fa06-43b7-be57-1dc3045b9651", "name": "network-vif-plugged", "status": "completed", "tag": "581e55c1-7b9e-4284-8d45-c0506fd756f1"}]} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:46:53.311678 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-b6d729b7-ef24-4467-9bce-0dca77c54cf0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:53.319042 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-fba996cf-044f-42f3-9380-0cdef03f31ab req-30ef1303-9b0f-4a11-8cd5-e0ae44deac74 service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:53.319895 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-fba996cf-044f-42f3-9380-0cdef03f31ab req-30ef1303-9b0f-4a11-8cd5-e0ae44deac74 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:53.320591 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-fba996cf-044f-42f3-9380-0cdef03f31ab req-30ef1303-9b0f-4a11-8cd5-e0ae44deac74 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:53.322604 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-b6d729b7-ef24-4467-9bce-0dca77c54cf0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:53.324736 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-b6d729b7-ef24-4467-9bce-0dca77c54cf0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:53.327488 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-b6d729b7-ef24-4467-9bce-0dca77c54cf0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1740 microversion: 2.20 time: 0.204630 Aug 24 07:46:53.328572 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 382/774] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:46:53 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1740 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:46:53.338651 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.compute.server_external_events [req-fba996cf-044f-42f3-9380-0cdef03f31ab req-30ef1303-9b0f-4a11-8cd5-e0ae44deac74 service nova] Creating event network-vif-plugged:581e55c1-7b9e-4284-8d45-c0506fd756f1 for instance a80b309c-fa06-43b7-be57-1dc3045b9651 on hv-cinder-85427 Aug 24 07:46:53.347423 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [req-fba996cf-044f-42f3-9380-0cdef03f31ab req-30ef1303-9b0f-4a11-8cd5-e0ae44deac74 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045027 Aug 24 07:46:53.348347 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 393/775] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:46:54.350040 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-b6038756-e370-4738-990c-ecf14aaab33e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:54.350683 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-b6038756-e370-4738-990c-ecf14aaab33e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:54.357487 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b6038756-e370-4738-990c-ecf14aaab33e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:54.357998 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b6038756-e370-4738-990c-ecf14aaab33e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:54.358431 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b6038756-e370-4738-990c-ecf14aaab33e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:54.359176 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b6038756-e370-4738-990c-ecf14aaab33e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:54.359630 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b6038756-e370-4738-990c-ecf14aaab33e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:54.360244 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b6038756-e370-4738-990c-ecf14aaab33e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:54.508683 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-b6038756-e370-4738-990c-ecf14aaab33e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:54.518112 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-b6038756-e370-4738-990c-ecf14aaab33e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:54.519674 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-b6038756-e370-4738-990c-ecf14aaab33e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:54.520925 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-b6038756-e370-4738-990c-ecf14aaab33e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1740 microversion: 2.20 time: 0.174860 Aug 24 07:46:54.521756 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 383/776] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:46:54 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1740 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:46:55.544967 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-2e0b1a70-29e4-49ca-ac6d-11125a12f621 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:55.546494 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-2e0b1a70-29e4-49ca-ac6d-11125a12f621 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:55.554519 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2e0b1a70-29e4-49ca-ac6d-11125a12f621 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:55.556397 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2e0b1a70-29e4-49ca-ac6d-11125a12f621 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:55.557163 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2e0b1a70-29e4-49ca-ac6d-11125a12f621 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:55.558580 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2e0b1a70-29e4-49ca-ac6d-11125a12f621 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:55.559290 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2e0b1a70-29e4-49ca-ac6d-11125a12f621 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:55.559783 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2e0b1a70-29e4-49ca-ac6d-11125a12f621 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:55.706342 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-2e0b1a70-29e4-49ca-ac6d-11125a12f621 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:55.716794 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-2e0b1a70-29e4-49ca-ac6d-11125a12f621 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:55.718667 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-2e0b1a70-29e4-49ca-ac6d-11125a12f621 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:55.720386 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-2e0b1a70-29e4-49ca-ac6d-11125a12f621 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1740 microversion: 2.20 time: 0.179408 Aug 24 07:46:55.721457 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 394/777] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:46:55 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1740 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:46:56.747362 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-45de909d-d3c6-47b8-9af2-eb53fb11f5de tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:56.748818 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-45de909d-d3c6-47b8-9af2-eb53fb11f5de tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:56.755887 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-45de909d-d3c6-47b8-9af2-eb53fb11f5de tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:56.756367 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-45de909d-d3c6-47b8-9af2-eb53fb11f5de tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:56.756998 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-45de909d-d3c6-47b8-9af2-eb53fb11f5de tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:56.757865 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-45de909d-d3c6-47b8-9af2-eb53fb11f5de tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:56.760537 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-45de909d-d3c6-47b8-9af2-eb53fb11f5de tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:56.761383 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-45de909d-d3c6-47b8-9af2-eb53fb11f5de tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:56.915282 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-45de909d-d3c6-47b8-9af2-eb53fb11f5de tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:56.924685 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-45de909d-d3c6-47b8-9af2-eb53fb11f5de tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:56.926212 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-45de909d-d3c6-47b8-9af2-eb53fb11f5de tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:56.927422 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-45de909d-d3c6-47b8-9af2-eb53fb11f5de tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1740 microversion: 2.20 time: 0.188194 Aug 24 07:46:56.928289 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 384/778] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:46:56 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:46:57.952700 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-b07ca2ed-dcff-4caa-a382-15865a4a643d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:57.953308 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-b07ca2ed-dcff-4caa-a382-15865a4a643d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:57.960565 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b07ca2ed-dcff-4caa-a382-15865a4a643d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:57.961053 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b07ca2ed-dcff-4caa-a382-15865a4a643d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:57.961484 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b07ca2ed-dcff-4caa-a382-15865a4a643d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:57.962236 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b07ca2ed-dcff-4caa-a382-15865a4a643d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:57.962613 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b07ca2ed-dcff-4caa-a382-15865a4a643d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:57.963244 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b07ca2ed-dcff-4caa-a382-15865a4a643d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:58.139585 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-b07ca2ed-dcff-4caa-a382-15865a4a643d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:58.152375 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-b07ca2ed-dcff-4caa-a382-15865a4a643d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:58.161721 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-b07ca2ed-dcff-4caa-a382-15865a4a643d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:58.164891 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-b07ca2ed-dcff-4caa-a382-15865a4a643d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1740 microversion: 2.20 time: 0.214795 Aug 24 07:46:58.179215 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 395/779] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:46:57 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1740 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:46:59.189127 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-0f9e6eee-63e2-4f0f-8703-427396c7c86e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:46:59.189950 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-0f9e6eee-63e2-4f0f-8703-427396c7c86e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:46:59.196962 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0f9e6eee-63e2-4f0f-8703-427396c7c86e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:59.197871 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0f9e6eee-63e2-4f0f-8703-427396c7c86e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:59.198498 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0f9e6eee-63e2-4f0f-8703-427396c7c86e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:59.199601 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0f9e6eee-63e2-4f0f-8703-427396c7c86e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:46:59.200413 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0f9e6eee-63e2-4f0f-8703-427396c7c86e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:46:59.201053 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0f9e6eee-63e2-4f0f-8703-427396c7c86e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:46:59.369728 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-0f9e6eee-63e2-4f0f-8703-427396c7c86e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:59.380970 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-0f9e6eee-63e2-4f0f-8703-427396c7c86e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:59.382821 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-0f9e6eee-63e2-4f0f-8703-427396c7c86e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:46:59.384266 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-0f9e6eee-63e2-4f0f-8703-427396c7c86e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1740 microversion: 2.20 time: 0.198997 Aug 24 07:46:59.386198 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 385/780] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:46:59 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1740 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:47:00.411196 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-29b26404-a9da-4ce4-ac9d-bec9269ae390 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:00.412436 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-29b26404-a9da-4ce4-ac9d-bec9269ae390 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:00.418985 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-29b26404-a9da-4ce4-ac9d-bec9269ae390 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:00.419458 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-29b26404-a9da-4ce4-ac9d-bec9269ae390 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:00.419882 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-29b26404-a9da-4ce4-ac9d-bec9269ae390 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:00.420596 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-29b26404-a9da-4ce4-ac9d-bec9269ae390 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:00.421040 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-29b26404-a9da-4ce4-ac9d-bec9269ae390 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:00.421451 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-29b26404-a9da-4ce4-ac9d-bec9269ae390 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:00.424364 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell1:SELECT=76 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:00.572375 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-29b26404-a9da-4ce4-ac9d-bec9269ae390 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:00.587399 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-29b26404-a9da-4ce4-ac9d-bec9269ae390 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:00.591981 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-29b26404-a9da-4ce4-ac9d-bec9269ae390 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:00.593461 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-29b26404-a9da-4ce4-ac9d-bec9269ae390 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1740 microversion: 2.20 time: 0.188458 Aug 24 07:47:00.594487 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 396/781] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:47:00 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1740 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:47:01.617162 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-ca34d1be-800f-4e6e-aac4-1ccb21a55fd1 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:01.617746 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-ca34d1be-800f-4e6e-aac4-1ccb21a55fd1 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:01.623570 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ca34d1be-800f-4e6e-aac4-1ccb21a55fd1 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:01.624042 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ca34d1be-800f-4e6e-aac4-1ccb21a55fd1 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:01.624463 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ca34d1be-800f-4e6e-aac4-1ccb21a55fd1 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:01.625139 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ca34d1be-800f-4e6e-aac4-1ccb21a55fd1 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:01.625579 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ca34d1be-800f-4e6e-aac4-1ccb21a55fd1 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:01.625989 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ca34d1be-800f-4e6e-aac4-1ccb21a55fd1 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:01.629829 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell1:SELECT=81 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:01.828372 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-ca34d1be-800f-4e6e-aac4-1ccb21a55fd1 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:01.836760 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-ca34d1be-800f-4e6e-aac4-1ccb21a55fd1 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:01.838273 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-ca34d1be-800f-4e6e-aac4-1ccb21a55fd1 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:01.839456 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-ca34d1be-800f-4e6e-aac4-1ccb21a55fd1 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1722 microversion: 2.20 time: 0.226296 Aug 24 07:47:01.840017 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 386/782] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:47:01 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:47:02.862798 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-2b6f4de1-0b8c-44dd-b769-a66d374af7be tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:02.863412 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-2b6f4de1-0b8c-44dd-b769-a66d374af7be tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:02.869848 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2b6f4de1-0b8c-44dd-b769-a66d374af7be tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:02.870336 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2b6f4de1-0b8c-44dd-b769-a66d374af7be tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:02.870802 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2b6f4de1-0b8c-44dd-b769-a66d374af7be tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:02.871490 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2b6f4de1-0b8c-44dd-b769-a66d374af7be tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:02.871945 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2b6f4de1-0b8c-44dd-b769-a66d374af7be tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:02.872364 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2b6f4de1-0b8c-44dd-b769-a66d374af7be tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:03.000013 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-2b6f4de1-0b8c-44dd-b769-a66d374af7be tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:03.008487 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-2b6f4de1-0b8c-44dd-b769-a66d374af7be tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:03.009985 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-2b6f4de1-0b8c-44dd-b769-a66d374af7be tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:03.011178 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-2b6f4de1-0b8c-44dd-b769-a66d374af7be tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1722 microversion: 2.20 time: 0.152413 Aug 24 07:47:03.011735 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 397/783] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:47:02 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:47:03.246141 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [req-1b1113df-c4ae-4ab0-8d1c-d6c10c8c732d req-bf89fd9a-24e8-4d44-8706-40f1fa218a95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a80b309c-fa06-43b7-be57-1dc3045b9651", "name": "network-vif-unplugged", "status": "completed", "tag": "581e55c1-7b9e-4284-8d45-c0506fd756f1"}]} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:47:03.256420 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-1b1113df-c4ae-4ab0-8d1c-d6c10c8c732d req-bf89fd9a-24e8-4d44-8706-40f1fa218a95 service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:03.256915 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-1b1113df-c4ae-4ab0-8d1c-d6c10c8c732d req-bf89fd9a-24e8-4d44-8706-40f1fa218a95 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:03.257347 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-1b1113df-c4ae-4ab0-8d1c-d6c10c8c732d req-bf89fd9a-24e8-4d44-8706-40f1fa218a95 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:03.268890 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.compute.server_external_events [req-1b1113df-c4ae-4ab0-8d1c-d6c10c8c732d req-bf89fd9a-24e8-4d44-8706-40f1fa218a95 service nova] Creating event network-vif-unplugged:581e55c1-7b9e-4284-8d45-c0506fd756f1 for instance a80b309c-fa06-43b7-be57-1dc3045b9651 on hv-cinder-85427 Aug 24 07:47:03.273970 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [req-1b1113df-c4ae-4ab0-8d1c-d6c10c8c732d req-bf89fd9a-24e8-4d44-8706-40f1fa218a95 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031423 Aug 24 07:47:03.274560 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 387/784] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:47:04.034746 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-25b14caf-fe59-443e-b10e-91fd79943b68 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:04.035457 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-25b14caf-fe59-443e-b10e-91fd79943b68 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:04.042140 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-25b14caf-fe59-443e-b10e-91fd79943b68 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:04.043024 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-25b14caf-fe59-443e-b10e-91fd79943b68 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:04.043532 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-25b14caf-fe59-443e-b10e-91fd79943b68 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:04.044410 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-25b14caf-fe59-443e-b10e-91fd79943b68 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:04.045069 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-25b14caf-fe59-443e-b10e-91fd79943b68 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:04.045576 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-25b14caf-fe59-443e-b10e-91fd79943b68 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:04.187727 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-25b14caf-fe59-443e-b10e-91fd79943b68 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:04.196840 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-25b14caf-fe59-443e-b10e-91fd79943b68 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:04.198391 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-25b14caf-fe59-443e-b10e-91fd79943b68 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:04.199704 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-25b14caf-fe59-443e-b10e-91fd79943b68 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1725 microversion: 2.20 time: 0.169717 Aug 24 07:47:04.200260 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 398/785] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:47:04 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:47:04.222156 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-b56036c5-2d76-4010-b71e-48eba986fed7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73d8df03-e088-42da-8590-5b4612de87dd"}} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:47:04.224909 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-b56036c5-2d76-4010-b71e-48eba986fed7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:04.231084 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b56036c5-2d76-4010-b71e-48eba986fed7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:04.231554 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b56036c5-2d76-4010-b71e-48eba986fed7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:04.231987 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b56036c5-2d76-4010-b71e-48eba986fed7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:04.232679 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b56036c5-2d76-4010-b71e-48eba986fed7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:04.233271 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b56036c5-2d76-4010-b71e-48eba986fed7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:04.233684 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b56036c5-2d76-4010-b71e-48eba986fed7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:04.533778 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-b56036c5-2d76-4010-b71e-48eba986fed7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "POST /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.315778 Aug 24 07:47:04.535171 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 388/786] 10.222.0.42 () {62 vars in 1364 bytes} [Wed Aug 24 07:47:04 2022] POST /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651/os-volume_attachments => generated 188 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 07:47:04.662286 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-71cbcf33-5f83-49ed-8a39-409b232a5866 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:47:04.662917 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-71cbcf33-5f83-49ed-8a39-409b232a5866 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:04.668923 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-71cbcf33-5f83-49ed-8a39-409b232a5866 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:04.669353 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-71cbcf33-5f83-49ed-8a39-409b232a5866 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:04.669792 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-71cbcf33-5f83-49ed-8a39-409b232a5866 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:04.670483 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-71cbcf33-5f83-49ed-8a39-409b232a5866 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:04.670994 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-71cbcf33-5f83-49ed-8a39-409b232a5866 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:04.671417 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-71cbcf33-5f83-49ed-8a39-409b232a5866 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:04.863304 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-71cbcf33-5f83-49ed-8a39-409b232a5866 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127114) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 07:47:04.935040 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-71cbcf33-5f83-49ed-8a39-409b232a5866 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "POST /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651/action" status: 202 len: 0 microversion: 2.20 time: 0.276476 Aug 24 07:47:04.935654 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 399/787] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 24 07:47:04 2022] POST /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 07:47:04.944469 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-70671340-0abe-44fa-9495-7660cc445da8 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:04.945262 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-70671340-0abe-44fa-9495-7660cc445da8 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:04.952219 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-70671340-0abe-44fa-9495-7660cc445da8 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:04.952708 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-70671340-0abe-44fa-9495-7660cc445da8 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:04.953321 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-70671340-0abe-44fa-9495-7660cc445da8 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:04.954021 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-70671340-0abe-44fa-9495-7660cc445da8 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:04.954472 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-70671340-0abe-44fa-9495-7660cc445da8 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:04.954924 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-70671340-0abe-44fa-9495-7660cc445da8 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:05.114596 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-70671340-0abe-44fa-9495-7660cc445da8 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:05.124781 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-70671340-0abe-44fa-9495-7660cc445da8 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:05.127279 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-70671340-0abe-44fa-9495-7660cc445da8 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:05.128438 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-70671340-0abe-44fa-9495-7660cc445da8 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1751 microversion: 2.20 time: 0.187910 Aug 24 07:47:05.129317 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 389/788] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:47:04 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1751 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:47:06.152091 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-d25b68c7-ee59-4305-a9e4-501d0d1f3845 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:06.152768 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-d25b68c7-ee59-4305-a9e4-501d0d1f3845 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:06.160304 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d25b68c7-ee59-4305-a9e4-501d0d1f3845 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:06.161094 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d25b68c7-ee59-4305-a9e4-501d0d1f3845 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:06.161922 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d25b68c7-ee59-4305-a9e4-501d0d1f3845 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:06.162948 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d25b68c7-ee59-4305-a9e4-501d0d1f3845 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:06.163465 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d25b68c7-ee59-4305-a9e4-501d0d1f3845 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:06.164015 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d25b68c7-ee59-4305-a9e4-501d0d1f3845 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:06.303508 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-d25b68c7-ee59-4305-a9e4-501d0d1f3845 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:06.312509 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-d25b68c7-ee59-4305-a9e4-501d0d1f3845 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:06.314177 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-d25b68c7-ee59-4305-a9e4-501d0d1f3845 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:06.315383 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-d25b68c7-ee59-4305-a9e4-501d0d1f3845 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1751 microversion: 2.20 time: 0.167860 Aug 24 07:47:06.315937 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 400/789] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:47:06 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1751 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:47:07.338984 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-f934bd82-ca18-4819-a667-c72b2d0e4135 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:07.340246 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-f934bd82-ca18-4819-a667-c72b2d0e4135 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:07.347646 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f934bd82-ca18-4819-a667-c72b2d0e4135 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:07.348125 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f934bd82-ca18-4819-a667-c72b2d0e4135 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:07.348549 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f934bd82-ca18-4819-a667-c72b2d0e4135 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:07.349239 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f934bd82-ca18-4819-a667-c72b2d0e4135 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:07.349708 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f934bd82-ca18-4819-a667-c72b2d0e4135 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:07.350123 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f934bd82-ca18-4819-a667-c72b2d0e4135 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:07.696430 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-f934bd82-ca18-4819-a667-c72b2d0e4135 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:07.705692 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-f934bd82-ca18-4819-a667-c72b2d0e4135 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:07.707244 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-f934bd82-ca18-4819-a667-c72b2d0e4135 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:07.708397 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-f934bd82-ca18-4819-a667-c72b2d0e4135 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1809 microversion: 2.20 time: 0.373448 Aug 24 07:47:07.709209 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 390/790] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:47:07 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1809 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:47:08.731038 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-f8127a1e-73a0-4210-8edf-47da53c5453b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:08.732328 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-f8127a1e-73a0-4210-8edf-47da53c5453b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:08.735018 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:08.740273 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f8127a1e-73a0-4210-8edf-47da53c5453b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:08.741052 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f8127a1e-73a0-4210-8edf-47da53c5453b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:08.742048 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f8127a1e-73a0-4210-8edf-47da53c5453b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:08.742840 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f8127a1e-73a0-4210-8edf-47da53c5453b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:08.743515 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f8127a1e-73a0-4210-8edf-47da53c5453b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:08.744008 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f8127a1e-73a0-4210-8edf-47da53c5453b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:08.891949 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-f8127a1e-73a0-4210-8edf-47da53c5453b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:08.901330 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-f8127a1e-73a0-4210-8edf-47da53c5453b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:08.903093 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-f8127a1e-73a0-4210-8edf-47da53c5453b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:08.904419 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-f8127a1e-73a0-4210-8edf-47da53c5453b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1809 microversion: 2.20 time: 0.177424 Aug 24 07:47:08.905055 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 401/791] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:47:08 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:47:09.929342 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-957704a3-1508-4d5e-bf21-bfe091e1b4ff tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:09.930668 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-957704a3-1508-4d5e-bf21-bfe091e1b4ff tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:09.935361 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_api:SELECT=30 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:09.939946 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-957704a3-1508-4d5e-bf21-bfe091e1b4ff tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:09.940518 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-957704a3-1508-4d5e-bf21-bfe091e1b4ff tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:09.941027 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-957704a3-1508-4d5e-bf21-bfe091e1b4ff tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:09.941800 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-957704a3-1508-4d5e-bf21-bfe091e1b4ff tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:09.942402 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-957704a3-1508-4d5e-bf21-bfe091e1b4ff tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:09.947842 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-957704a3-1508-4d5e-bf21-bfe091e1b4ff tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:10.158359 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-957704a3-1508-4d5e-bf21-bfe091e1b4ff tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:10.168708 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-957704a3-1508-4d5e-bf21-bfe091e1b4ff tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:10.170225 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-957704a3-1508-4d5e-bf21-bfe091e1b4ff tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:10.171413 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-957704a3-1508-4d5e-bf21-bfe091e1b4ff tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1809 microversion: 2.20 time: 0.246975 Aug 24 07:47:10.171960 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 391/792] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:47:09 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1809 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:47:11.195035 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-2890efda-915a-4dd7-831c-78e479bd0776 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:11.195896 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-2890efda-915a-4dd7-831c-78e479bd0776 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:11.202657 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2890efda-915a-4dd7-831c-78e479bd0776 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:11.203187 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2890efda-915a-4dd7-831c-78e479bd0776 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:11.203963 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2890efda-915a-4dd7-831c-78e479bd0776 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:11.204667 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2890efda-915a-4dd7-831c-78e479bd0776 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:11.205121 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2890efda-915a-4dd7-831c-78e479bd0776 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:11.205547 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2890efda-915a-4dd7-831c-78e479bd0776 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:11.351605 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-2890efda-915a-4dd7-831c-78e479bd0776 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:11.367083 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-2890efda-915a-4dd7-831c-78e479bd0776 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:11.373536 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-2890efda-915a-4dd7-831c-78e479bd0776 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:11.375202 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-2890efda-915a-4dd7-831c-78e479bd0776 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1809 microversion: 2.20 time: 0.184188 Aug 24 07:47:11.376146 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 402/793] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:47:11 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1809 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:47:12.401195 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-ff5d7b00-b662-4549-8e26-17f314a081f6 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:12.402795 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-ff5d7b00-b662-4549-8e26-17f314a081f6 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:12.409635 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ff5d7b00-b662-4549-8e26-17f314a081f6 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:12.410129 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ff5d7b00-b662-4549-8e26-17f314a081f6 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:12.410563 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ff5d7b00-b662-4549-8e26-17f314a081f6 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:12.411330 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ff5d7b00-b662-4549-8e26-17f314a081f6 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:12.411782 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ff5d7b00-b662-4549-8e26-17f314a081f6 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:12.412261 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ff5d7b00-b662-4549-8e26-17f314a081f6 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:12.595866 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-ff5d7b00-b662-4549-8e26-17f314a081f6 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:12.609646 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-ff5d7b00-b662-4549-8e26-17f314a081f6 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:12.611773 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-ff5d7b00-b662-4549-8e26-17f314a081f6 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:12.613165 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-ff5d7b00-b662-4549-8e26-17f314a081f6 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1809 microversion: 2.20 time: 0.215859 Aug 24 07:47:12.613888 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 392/794] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:47:12 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1809 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:47:13.640807 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-476c90f6-d0d3-432f-9592-dc3e3a5b72c6 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:13.641460 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-476c90f6-d0d3-432f-9592-dc3e3a5b72c6 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:13.649393 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-476c90f6-d0d3-432f-9592-dc3e3a5b72c6 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:13.649875 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-476c90f6-d0d3-432f-9592-dc3e3a5b72c6 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:13.650306 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-476c90f6-d0d3-432f-9592-dc3e3a5b72c6 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:13.651035 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-476c90f6-d0d3-432f-9592-dc3e3a5b72c6 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:13.651560 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-476c90f6-d0d3-432f-9592-dc3e3a5b72c6 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:13.654914 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-476c90f6-d0d3-432f-9592-dc3e3a5b72c6 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:13.822637 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-476c90f6-d0d3-432f-9592-dc3e3a5b72c6 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:13.834058 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-476c90f6-d0d3-432f-9592-dc3e3a5b72c6 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:13.836256 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-476c90f6-d0d3-432f-9592-dc3e3a5b72c6 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:13.838037 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-476c90f6-d0d3-432f-9592-dc3e3a5b72c6 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1809 microversion: 2.20 time: 0.200484 Aug 24 07:47:13.839378 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 403/795] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:47:13 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1809 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:47:14.863420 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-b8eb0aa9-cbc5-420e-bb5c-dda4c3ec4e7f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:14.864560 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-b8eb0aa9-cbc5-420e-bb5c-dda4c3ec4e7f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:14.876387 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b8eb0aa9-cbc5-420e-bb5c-dda4c3ec4e7f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:14.878947 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b8eb0aa9-cbc5-420e-bb5c-dda4c3ec4e7f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:14.879649 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b8eb0aa9-cbc5-420e-bb5c-dda4c3ec4e7f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:14.881785 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b8eb0aa9-cbc5-420e-bb5c-dda4c3ec4e7f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:14.882493 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b8eb0aa9-cbc5-420e-bb5c-dda4c3ec4e7f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:14.884183 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b8eb0aa9-cbc5-420e-bb5c-dda4c3ec4e7f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:15.052631 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-b8eb0aa9-cbc5-420e-bb5c-dda4c3ec4e7f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:15.066954 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-b8eb0aa9-cbc5-420e-bb5c-dda4c3ec4e7f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:15.068455 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-b8eb0aa9-cbc5-420e-bb5c-dda4c3ec4e7f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:15.069731 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-b8eb0aa9-cbc5-420e-bb5c-dda4c3ec4e7f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1809 microversion: 2.20 time: 0.211883 Aug 24 07:47:15.070284 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 393/796] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:47:14 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1809 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 07:47:16.093742 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-79828c3e-5b3d-4de6-86fe-66baa7b5c221 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:16.094382 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-79828c3e-5b3d-4de6-86fe-66baa7b5c221 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:16.101327 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-79828c3e-5b3d-4de6-86fe-66baa7b5c221 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:16.102144 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-79828c3e-5b3d-4de6-86fe-66baa7b5c221 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:16.102783 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-79828c3e-5b3d-4de6-86fe-66baa7b5c221 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:16.103903 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-79828c3e-5b3d-4de6-86fe-66baa7b5c221 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:16.104353 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-79828c3e-5b3d-4de6-86fe-66baa7b5c221 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:16.104974 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-79828c3e-5b3d-4de6-86fe-66baa7b5c221 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:16.292321 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-79828c3e-5b3d-4de6-86fe-66baa7b5c221 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:16.303110 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-79828c3e-5b3d-4de6-86fe-66baa7b5c221 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:16.305121 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-79828c3e-5b3d-4de6-86fe-66baa7b5c221 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:16.306510 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-79828c3e-5b3d-4de6-86fe-66baa7b5c221 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1809 microversion: 2.20 time: 0.216619 Aug 24 07:47:16.307267 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 404/797] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:47:16 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1809 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:47:16.424680 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-e69dbe0e-fb76-4c26-a5ad-d3b3a1a69b8f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:16.425303 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-e69dbe0e-fb76-4c26-a5ad-d3b3a1a69b8f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: ac3c9f36-8b18-45dd-b610-76ffb47d5ae3] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:16.436364 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e69dbe0e-fb76-4c26-a5ad-d3b3a1a69b8f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:16.437065 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e69dbe0e-fb76-4c26-a5ad-d3b3a1a69b8f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:16.437701 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e69dbe0e-fb76-4c26-a5ad-d3b3a1a69b8f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:16.439329 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e69dbe0e-fb76-4c26-a5ad-d3b3a1a69b8f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:16.439783 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e69dbe0e-fb76-4c26-a5ad-d3b3a1a69b8f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:16.440395 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e69dbe0e-fb76-4c26-a5ad-d3b3a1a69b8f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:16.476459 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-e69dbe0e-fb76-4c26-a5ad-d3b3a1a69b8f tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3/ips" status: 200 len: 149 microversion: 2.1 time: 0.067525 Aug 24 07:47:16.491504 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 394/798] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Aug 24 07:47:16 2022] GET /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3/ips => generated 149 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:47:17.336578 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-d8a3fd51-5c7c-43df-8d82-b439fb99638f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:17.337181 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-d8a3fd51-5c7c-43df-8d82-b439fb99638f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:17.343542 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d8a3fd51-5c7c-43df-8d82-b439fb99638f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:17.344016 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d8a3fd51-5c7c-43df-8d82-b439fb99638f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:17.344440 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d8a3fd51-5c7c-43df-8d82-b439fb99638f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:17.345113 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d8a3fd51-5c7c-43df-8d82-b439fb99638f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:17.345556 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d8a3fd51-5c7c-43df-8d82-b439fb99638f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:17.345966 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d8a3fd51-5c7c-43df-8d82-b439fb99638f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:17.476809 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-d8a3fd51-5c7c-43df-8d82-b439fb99638f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:17.485465 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-d8a3fd51-5c7c-43df-8d82-b439fb99638f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:17.486979 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-d8a3fd51-5c7c-43df-8d82-b439fb99638f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:17.488122 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-d8a3fd51-5c7c-43df-8d82-b439fb99638f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1809 microversion: 2.20 time: 0.155423 Aug 24 07:47:17.488669 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 405/799] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:47:17 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:47:17.846038 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-84872c61-546c-4cce-b91d-a126cabeefa6 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ea0fbac-5fde-4cba-83b0-6699e9333912"}} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:47:17.848416 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-84872c61-546c-4cce-b91d-a126cabeefa6 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: ac3c9f36-8b18-45dd-b610-76ffb47d5ae3] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:17.855062 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-84872c61-546c-4cce-b91d-a126cabeefa6 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:17.855540 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-84872c61-546c-4cce-b91d-a126cabeefa6 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:17.855964 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-84872c61-546c-4cce-b91d-a126cabeefa6 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:17.856638 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-84872c61-546c-4cce-b91d-a126cabeefa6 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:17.857083 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-84872c61-546c-4cce-b91d-a126cabeefa6 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:17.857498 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-84872c61-546c-4cce-b91d-a126cabeefa6 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:18.091718 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-84872c61-546c-4cce-b91d-a126cabeefa6 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "POST /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.250317 Aug 24 07:47:18.092311 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 395/800] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Aug 24 07:47:17 2022] POST /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3/os-volume_attachments => generated 194 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:47:18.510745 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-a571c646-16b5-40e5-b461-f7d2eb0cf6d7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:18.511382 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-a571c646-16b5-40e5-b461-f7d2eb0cf6d7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:18.518232 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a571c646-16b5-40e5-b461-f7d2eb0cf6d7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:18.518794 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a571c646-16b5-40e5-b461-f7d2eb0cf6d7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:18.519247 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a571c646-16b5-40e5-b461-f7d2eb0cf6d7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:18.520088 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a571c646-16b5-40e5-b461-f7d2eb0cf6d7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:18.520546 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a571c646-16b5-40e5-b461-f7d2eb0cf6d7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:18.520971 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a571c646-16b5-40e5-b461-f7d2eb0cf6d7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:18.647156 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-a571c646-16b5-40e5-b461-f7d2eb0cf6d7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:18.655819 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-a571c646-16b5-40e5-b461-f7d2eb0cf6d7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:18.657951 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-a571c646-16b5-40e5-b461-f7d2eb0cf6d7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:18.659139 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-a571c646-16b5-40e5-b461-f7d2eb0cf6d7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1809 microversion: 2.20 time: 0.152302 Aug 24 07:47:18.659699 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 406/801] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:47:18 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 07:47:19.682846 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-6d625221-dcaa-44ec-a2d8-9680081fc82b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:19.683479 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-6d625221-dcaa-44ec-a2d8-9680081fc82b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:19.689986 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6d625221-dcaa-44ec-a2d8-9680081fc82b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:19.690456 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6d625221-dcaa-44ec-a2d8-9680081fc82b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:19.690981 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6d625221-dcaa-44ec-a2d8-9680081fc82b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:19.691651 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6d625221-dcaa-44ec-a2d8-9680081fc82b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:19.692092 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6d625221-dcaa-44ec-a2d8-9680081fc82b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:19.692503 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6d625221-dcaa-44ec-a2d8-9680081fc82b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:19.821708 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-6d625221-dcaa-44ec-a2d8-9680081fc82b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:19.830877 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-6d625221-dcaa-44ec-a2d8-9680081fc82b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:19.832373 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-6d625221-dcaa-44ec-a2d8-9680081fc82b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:19.833510 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-6d625221-dcaa-44ec-a2d8-9680081fc82b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1809 microversion: 2.20 time: 0.155447 Aug 24 07:47:19.834058 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 396/802] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:47:19 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:47:20.310677 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-ee4f1b42-c51d-4c2e-8441-105b4354c05a tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:47:20.311231 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-ee4f1b42-c51d-4c2e-8441-105b4354c05a tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:20.317802 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ee4f1b42-c51d-4c2e-8441-105b4354c05a tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:20.318286 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ee4f1b42-c51d-4c2e-8441-105b4354c05a tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:20.318732 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ee4f1b42-c51d-4c2e-8441-105b4354c05a tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:20.319420 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ee4f1b42-c51d-4c2e-8441-105b4354c05a tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:20.319873 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ee4f1b42-c51d-4c2e-8441-105b4354c05a tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:20.320345 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ee4f1b42-c51d-4c2e-8441-105b4354c05a tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:20.342376 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.objects.instance [None req-ee4f1b42-c51d-4c2e-8441-105b4354c05a tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lazy-loading 'flavor' on Instance uuid b258660f-e099-4e37-ab2a-4049ad88a647 {{(pid=127114) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:47:20.458271 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-ee4f1b42-c51d-4c2e-8441-105b4354c05a tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "POST /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647/action" status: 202 len: 0 microversion: 2.1 time: 0.151246 Aug 24 07:47:20.459149 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 407/803] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 24 07:47:20 2022] POST /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 07:47:20.470412 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-e4df2cf3-23eb-4e5b-bba6-2756c511f229 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:20.471516 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-e4df2cf3-23eb-4e5b-bba6-2756c511f229 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:20.478167 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e4df2cf3-23eb-4e5b-bba6-2756c511f229 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:20.478666 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e4df2cf3-23eb-4e5b-bba6-2756c511f229 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:20.479218 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e4df2cf3-23eb-4e5b-bba6-2756c511f229 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:20.480051 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e4df2cf3-23eb-4e5b-bba6-2756c511f229 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:20.480513 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e4df2cf3-23eb-4e5b-bba6-2756c511f229 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:20.480934 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e4df2cf3-23eb-4e5b-bba6-2756c511f229 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:20.627455 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-e4df2cf3-23eb-4e5b-bba6-2756c511f229 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:20.635331 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-e4df2cf3-23eb-4e5b-bba6-2756c511f229 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1566 microversion: 2.1 time: 0.170470 Aug 24 07:47:20.635957 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 397/804] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:47:20 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1566 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:47:20.856635 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-c5099db0-4706-4ca3-97b1-a325c374faf5 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:20.857328 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-c5099db0-4706-4ca3-97b1-a325c374faf5 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:20.863440 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c5099db0-4706-4ca3-97b1-a325c374faf5 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:20.863918 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c5099db0-4706-4ca3-97b1-a325c374faf5 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:20.864348 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c5099db0-4706-4ca3-97b1-a325c374faf5 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:20.865025 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c5099db0-4706-4ca3-97b1-a325c374faf5 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:20.865480 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c5099db0-4706-4ca3-97b1-a325c374faf5 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:20.865904 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c5099db0-4706-4ca3-97b1-a325c374faf5 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:20.993881 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-c5099db0-4706-4ca3-97b1-a325c374faf5 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:21.003001 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-c5099db0-4706-4ca3-97b1-a325c374faf5 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:21.004499 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-c5099db0-4706-4ca3-97b1-a325c374faf5 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:21.005650 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-c5099db0-4706-4ca3-97b1-a325c374faf5 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1809 microversion: 2.20 time: 0.153282 Aug 24 07:47:21.006195 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 408/805] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:47:20 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:47:21.657668 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-55c95a1a-f989-4869-809f-2101e8012b8e tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:21.658385 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-55c95a1a-f989-4869-809f-2101e8012b8e tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:21.665957 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-55c95a1a-f989-4869-809f-2101e8012b8e tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:21.666585 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-55c95a1a-f989-4869-809f-2101e8012b8e tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:21.667138 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-55c95a1a-f989-4869-809f-2101e8012b8e tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:21.668024 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-55c95a1a-f989-4869-809f-2101e8012b8e tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:21.668627 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-55c95a1a-f989-4869-809f-2101e8012b8e tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:21.669247 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-55c95a1a-f989-4869-809f-2101e8012b8e tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:21.858602 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-55c95a1a-f989-4869-809f-2101e8012b8e tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:21.868872 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-55c95a1a-f989-4869-809f-2101e8012b8e tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1566 microversion: 2.1 time: 0.215536 Aug 24 07:47:21.869438 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 398/806] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:47:21 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1566 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:47:22.028661 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-985e35d6-898d-413c-9127-afcc7fb82bcd tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:22.029393 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-985e35d6-898d-413c-9127-afcc7fb82bcd tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:22.036311 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-985e35d6-898d-413c-9127-afcc7fb82bcd tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:22.036786 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-985e35d6-898d-413c-9127-afcc7fb82bcd tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:22.037213 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-985e35d6-898d-413c-9127-afcc7fb82bcd tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:22.037898 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-985e35d6-898d-413c-9127-afcc7fb82bcd tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:22.038339 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-985e35d6-898d-413c-9127-afcc7fb82bcd tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:22.038791 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-985e35d6-898d-413c-9127-afcc7fb82bcd tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:22.169422 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-985e35d6-898d-413c-9127-afcc7fb82bcd tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:22.172392 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:22.180764 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-985e35d6-898d-413c-9127-afcc7fb82bcd tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:22.182264 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-985e35d6-898d-413c-9127-afcc7fb82bcd tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:22.183456 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-985e35d6-898d-413c-9127-afcc7fb82bcd tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1809 microversion: 2.20 time: 0.158787 Aug 24 07:47:22.184014 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 409/807] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:47:22 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:47:22.891303 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-8190dea8-1d6f-4e62-b556-41bc3ad8431c tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:22.891838 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-8190dea8-1d6f-4e62-b556-41bc3ad8431c tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:22.898580 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8190dea8-1d6f-4e62-b556-41bc3ad8431c tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:22.899191 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8190dea8-1d6f-4e62-b556-41bc3ad8431c tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:22.899724 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8190dea8-1d6f-4e62-b556-41bc3ad8431c tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:22.900401 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8190dea8-1d6f-4e62-b556-41bc3ad8431c tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:22.900852 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8190dea8-1d6f-4e62-b556-41bc3ad8431c tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:22.901267 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8190dea8-1d6f-4e62-b556-41bc3ad8431c tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:23.040566 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-8190dea8-1d6f-4e62-b556-41bc3ad8431c tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:23.042917 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:23.050384 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-8190dea8-1d6f-4e62-b556-41bc3ad8431c tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1566 microversion: 2.1 time: 0.163377 Aug 24 07:47:23.050977 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 399/808] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:47:22 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:47:23.205925 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-a887d5ca-cf12-4037-bf97-71b6f3fa29d4 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:23.206461 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-a887d5ca-cf12-4037-bf97-71b6f3fa29d4 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:23.213720 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a887d5ca-cf12-4037-bf97-71b6f3fa29d4 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:23.214200 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a887d5ca-cf12-4037-bf97-71b6f3fa29d4 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:23.214631 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a887d5ca-cf12-4037-bf97-71b6f3fa29d4 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:23.215336 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a887d5ca-cf12-4037-bf97-71b6f3fa29d4 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:23.215784 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a887d5ca-cf12-4037-bf97-71b6f3fa29d4 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:23.216205 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a887d5ca-cf12-4037-bf97-71b6f3fa29d4 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:23.354334 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-a887d5ca-cf12-4037-bf97-71b6f3fa29d4 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:23.363551 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-a887d5ca-cf12-4037-bf97-71b6f3fa29d4 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:23.365052 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-a887d5ca-cf12-4037-bf97-71b6f3fa29d4 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:23.366200 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-a887d5ca-cf12-4037-bf97-71b6f3fa29d4 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1809 microversion: 2.20 time: 0.164595 Aug 24 07:47:23.366808 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 410/809] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:47:23 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:47:24.071771 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-123489ac-7875-4681-8c87-75fdf43b1b28 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:24.072383 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-123489ac-7875-4681-8c87-75fdf43b1b28 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:24.080285 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-123489ac-7875-4681-8c87-75fdf43b1b28 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:24.080774 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-123489ac-7875-4681-8c87-75fdf43b1b28 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:24.081210 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-123489ac-7875-4681-8c87-75fdf43b1b28 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:24.081903 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-123489ac-7875-4681-8c87-75fdf43b1b28 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:24.082355 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-123489ac-7875-4681-8c87-75fdf43b1b28 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:24.082803 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-123489ac-7875-4681-8c87-75fdf43b1b28 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:24.244528 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-123489ac-7875-4681-8c87-75fdf43b1b28 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:24.253180 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-123489ac-7875-4681-8c87-75fdf43b1b28 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1566 microversion: 2.1 time: 0.185678 Aug 24 07:47:24.253754 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 400/810] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:47:24 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1566 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:47:24.389462 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-92840cb9-2cbc-4723-9c9a-b8b4bec190be tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:24.390138 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-92840cb9-2cbc-4723-9c9a-b8b4bec190be tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:24.397931 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-92840cb9-2cbc-4723-9c9a-b8b4bec190be tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:24.399170 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-92840cb9-2cbc-4723-9c9a-b8b4bec190be tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:24.399820 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-92840cb9-2cbc-4723-9c9a-b8b4bec190be tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:24.400775 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-92840cb9-2cbc-4723-9c9a-b8b4bec190be tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:24.401312 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-92840cb9-2cbc-4723-9c9a-b8b4bec190be tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:24.401962 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-92840cb9-2cbc-4723-9c9a-b8b4bec190be tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:24.591667 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-92840cb9-2cbc-4723-9c9a-b8b4bec190be tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:24.601758 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-92840cb9-2cbc-4723-9c9a-b8b4bec190be tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:24.605314 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-92840cb9-2cbc-4723-9c9a-b8b4bec190be tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:24.606731 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-92840cb9-2cbc-4723-9c9a-b8b4bec190be tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1809 microversion: 2.20 time: 0.221210 Aug 24 07:47:24.612831 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 411/811] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:47:24 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1809 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:47:24.697608 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-696a9261-c369-44e2-b093-2c7c5efbe3e0 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:24.698093 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-696a9261-c369-44e2-b093-2c7c5efbe3e0 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: ac3c9f36-8b18-45dd-b610-76ffb47d5ae3] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:24.704504 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-696a9261-c369-44e2-b093-2c7c5efbe3e0 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:24.705184 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-696a9261-c369-44e2-b093-2c7c5efbe3e0 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:24.705612 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-696a9261-c369-44e2-b093-2c7c5efbe3e0 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:24.706390 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-696a9261-c369-44e2-b093-2c7c5efbe3e0 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:24.706898 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-696a9261-c369-44e2-b093-2c7c5efbe3e0 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:24.707320 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-696a9261-c369-44e2-b093-2c7c5efbe3e0 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:24.798401 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.objects.instance [None req-696a9261-c369-44e2-b093-2c7c5efbe3e0 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lazy-loading 'services' on Instance uuid ac3c9f36-8b18-45dd-b610-76ffb47d5ae3 {{(pid=127113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:47:24.871633 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-696a9261-c369-44e2-b093-2c7c5efbe3e0 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3/os-volume_attachments/4ea0fbac-5fde-4cba-83b0-6699e9333912" status: 202 len: 0 microversion: 2.1 time: 0.177695 Aug 24 07:47:24.872243 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 401/812] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Aug 24 07:47:24 2022] DELETE /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3/os-volume_attachments/4ea0fbac-5fde-4cba-83b0-6699e9333912 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 07:47:24.881293 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-5b4f4aef-6ee9-4891-bb5f-2004786a70ba tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:24.883958 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-5b4f4aef-6ee9-4891-bb5f-2004786a70ba tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: ac3c9f36-8b18-45dd-b610-76ffb47d5ae3] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:24.890056 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5b4f4aef-6ee9-4891-bb5f-2004786a70ba tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:24.890451 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5b4f4aef-6ee9-4891-bb5f-2004786a70ba tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:24.891675 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5b4f4aef-6ee9-4891-bb5f-2004786a70ba tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:24.892564 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5b4f4aef-6ee9-4891-bb5f-2004786a70ba tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:24.893173 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5b4f4aef-6ee9-4891-bb5f-2004786a70ba tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:24.893604 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5b4f4aef-6ee9-4891-bb5f-2004786a70ba tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:24.925588 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-5b4f4aef-6ee9-4891-bb5f-2004786a70ba tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048140 Aug 24 07:47:24.926277 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 412/813] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 24 07:47:24 2022] GET /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:47:25.283553 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-734c061f-374e-4f71-a07b-511121a91124 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:25.284566 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-734c061f-374e-4f71-a07b-511121a91124 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:25.296056 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-734c061f-374e-4f71-a07b-511121a91124 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:25.296874 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-734c061f-374e-4f71-a07b-511121a91124 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:25.298130 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-734c061f-374e-4f71-a07b-511121a91124 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:25.298884 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-734c061f-374e-4f71-a07b-511121a91124 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:25.299572 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-734c061f-374e-4f71-a07b-511121a91124 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:25.300170 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-734c061f-374e-4f71-a07b-511121a91124 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:25.482660 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-734c061f-374e-4f71-a07b-511121a91124 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:25.492380 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-734c061f-374e-4f71-a07b-511121a91124 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1566 microversion: 2.1 time: 0.215203 Aug 24 07:47:25.492961 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 402/814] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:47:25 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1566 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:47:25.633051 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-8c81f226-02e1-47a7-9df0-5b30922a20fa tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:25.633947 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-8c81f226-02e1-47a7-9df0-5b30922a20fa tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:25.642342 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8c81f226-02e1-47a7-9df0-5b30922a20fa tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:25.642849 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8c81f226-02e1-47a7-9df0-5b30922a20fa tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:25.643279 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8c81f226-02e1-47a7-9df0-5b30922a20fa tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:25.643974 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8c81f226-02e1-47a7-9df0-5b30922a20fa tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:25.644653 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8c81f226-02e1-47a7-9df0-5b30922a20fa tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:25.645105 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8c81f226-02e1-47a7-9df0-5b30922a20fa tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:25.789027 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-8c81f226-02e1-47a7-9df0-5b30922a20fa tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:25.799423 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-8c81f226-02e1-47a7-9df0-5b30922a20fa tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:25.801033 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-8c81f226-02e1-47a7-9df0-5b30922a20fa tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:25.802319 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-8c81f226-02e1-47a7-9df0-5b30922a20fa tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1809 microversion: 2.20 time: 0.174791 Aug 24 07:47:25.803284 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 413/815] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:47:25 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:47:25.937279 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-a280d338-ff9c-47da-84c1-f900ecf1af70 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:25.939660 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-a280d338-ff9c-47da-84c1-f900ecf1af70 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: ac3c9f36-8b18-45dd-b610-76ffb47d5ae3] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:25.945695 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a280d338-ff9c-47da-84c1-f900ecf1af70 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:25.946170 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a280d338-ff9c-47da-84c1-f900ecf1af70 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:25.946597 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a280d338-ff9c-47da-84c1-f900ecf1af70 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:25.947309 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a280d338-ff9c-47da-84c1-f900ecf1af70 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:25.947755 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a280d338-ff9c-47da-84c1-f900ecf1af70 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:25.948171 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a280d338-ff9c-47da-84c1-f900ecf1af70 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:25.977236 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-a280d338-ff9c-47da-84c1-f900ecf1af70 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043817 Aug 24 07:47:25.977799 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 403/816] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Aug 24 07:47:25 2022] GET /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 07:47:26.041267 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-a7b320cd-3b2c-4748-adb5-801a30efd815 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:26.041888 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-a7b320cd-3b2c-4748-adb5-801a30efd815 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: ac3c9f36-8b18-45dd-b610-76ffb47d5ae3] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:26.048140 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a7b320cd-3b2c-4748-adb5-801a30efd815 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:26.048605 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a7b320cd-3b2c-4748-adb5-801a30efd815 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:26.049024 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a7b320cd-3b2c-4748-adb5-801a30efd815 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:26.049700 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a7b320cd-3b2c-4748-adb5-801a30efd815 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:26.050146 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a7b320cd-3b2c-4748-adb5-801a30efd815 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:26.050564 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a7b320cd-3b2c-4748-adb5-801a30efd815 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:26.074330 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-a7b320cd-3b2c-4748-adb5-801a30efd815 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: ac3c9f36-8b18-45dd-b610-76ffb47d5ae3] Going to try to terminate instance {{(pid=127114) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 07:47:26.153856 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-a7b320cd-3b2c-4748-adb5-801a30efd815 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3" status: 204 len: 0 microversion: 2.1 time: 0.115967 Aug 24 07:47:26.157184 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 414/817] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 24 07:47:26 2022] DELETE /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 07:47:26.164943 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-08d4fb0e-beba-4c6e-8d38-77d8c42cfdca tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:26.165558 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-08d4fb0e-beba-4c6e-8d38-77d8c42cfdca tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: ac3c9f36-8b18-45dd-b610-76ffb47d5ae3] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:26.171761 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-08d4fb0e-beba-4c6e-8d38-77d8c42cfdca tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:26.172538 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-08d4fb0e-beba-4c6e-8d38-77d8c42cfdca tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:26.172974 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-08d4fb0e-beba-4c6e-8d38-77d8c42cfdca tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:26.173664 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-08d4fb0e-beba-4c6e-8d38-77d8c42cfdca tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:26.174117 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-08d4fb0e-beba-4c6e-8d38-77d8c42cfdca tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:26.174540 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-08d4fb0e-beba-4c6e-8d38-77d8c42cfdca tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:26.310473 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-08d4fb0e-beba-4c6e-8d38-77d8c42cfdca tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:26.318740 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-08d4fb0e-beba-4c6e-8d38-77d8c42cfdca tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3" status: 200 len: 1681 microversion: 2.1 time: 0.157475 Aug 24 07:47:26.319279 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 404/818] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:47:26 2022] GET /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:47:26.514295 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-db42fe75-ef02-45e8-9dbf-db434362cc45 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:26.515062 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-db42fe75-ef02-45e8-9dbf-db434362cc45 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:26.521929 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-db42fe75-ef02-45e8-9dbf-db434362cc45 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:26.522443 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-db42fe75-ef02-45e8-9dbf-db434362cc45 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:26.522911 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-db42fe75-ef02-45e8-9dbf-db434362cc45 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:26.523607 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-db42fe75-ef02-45e8-9dbf-db434362cc45 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:26.524058 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-db42fe75-ef02-45e8-9dbf-db434362cc45 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:26.524478 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-db42fe75-ef02-45e8-9dbf-db434362cc45 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:26.718627 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-db42fe75-ef02-45e8-9dbf-db434362cc45 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:26.727112 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-db42fe75-ef02-45e8-9dbf-db434362cc45 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1566 microversion: 2.1 time: 0.216981 Aug 24 07:47:26.727619 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 415/819] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:47:26 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1566 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:47:26.825944 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-86616b05-9645-48ce-acd4-f999f35ea2f2 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:26.826591 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-86616b05-9645-48ce-acd4-f999f35ea2f2 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:26.832727 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-86616b05-9645-48ce-acd4-f999f35ea2f2 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:26.833213 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-86616b05-9645-48ce-acd4-f999f35ea2f2 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:26.833648 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-86616b05-9645-48ce-acd4-f999f35ea2f2 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:26.834336 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-86616b05-9645-48ce-acd4-f999f35ea2f2 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:26.834819 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-86616b05-9645-48ce-acd4-f999f35ea2f2 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:26.835277 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-86616b05-9645-48ce-acd4-f999f35ea2f2 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:26.965194 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-86616b05-9645-48ce-acd4-f999f35ea2f2 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:26.974378 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-86616b05-9645-48ce-acd4-f999f35ea2f2 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:26.975917 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-86616b05-9645-48ce-acd4-f999f35ea2f2 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:26.977222 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-86616b05-9645-48ce-acd4-f999f35ea2f2 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1809 microversion: 2.20 time: 0.155098 Aug 24 07:47:26.989539 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 405/820] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:47:26 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:47:27.340398 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-80fff9eb-2415-4c88-8302-fce6434d096e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:27.341262 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-80fff9eb-2415-4c88-8302-fce6434d096e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: ac3c9f36-8b18-45dd-b610-76ffb47d5ae3] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:27.348206 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-80fff9eb-2415-4c88-8302-fce6434d096e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:27.348875 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-80fff9eb-2415-4c88-8302-fce6434d096e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:27.349540 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-80fff9eb-2415-4c88-8302-fce6434d096e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:27.350499 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-80fff9eb-2415-4c88-8302-fce6434d096e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:27.351297 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-80fff9eb-2415-4c88-8302-fce6434d096e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:27.351941 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-80fff9eb-2415-4c88-8302-fce6434d096e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:27.438770 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [req-4270061e-206b-4536-9ab0-215bdc2e2db3 req-6b44fe9c-88e0-41de-8994-3ac4295eb697 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a80b309c-fa06-43b7-be57-1dc3045b9651", "name": "network-vif-plugged", "status": "completed", "tag": "581e55c1-7b9e-4284-8d45-c0506fd756f1"}]} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:47:27.458042 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-4270061e-206b-4536-9ab0-215bdc2e2db3 req-6b44fe9c-88e0-41de-8994-3ac4295eb697 service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:27.458561 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-4270061e-206b-4536-9ab0-215bdc2e2db3 req-6b44fe9c-88e0-41de-8994-3ac4295eb697 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:27.459032 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-4270061e-206b-4536-9ab0-215bdc2e2db3 req-6b44fe9c-88e0-41de-8994-3ac4295eb697 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:27.474396 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.compute.server_external_events [req-4270061e-206b-4536-9ab0-215bdc2e2db3 req-6b44fe9c-88e0-41de-8994-3ac4295eb697 service nova] Creating event network-vif-plugged:581e55c1-7b9e-4284-8d45-c0506fd756f1 for instance a80b309c-fa06-43b7-be57-1dc3045b9651 on hv-cinder-85427 Aug 24 07:47:27.480165 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [req-4270061e-206b-4536-9ab0-215bdc2e2db3 req-6b44fe9c-88e0-41de-8994-3ac4295eb697 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044514 Aug 24 07:47:27.481447 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 406/821] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:47:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:47:27.512594 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-80fff9eb-2415-4c88-8302-fce6434d096e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:27.522827 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-80fff9eb-2415-4c88-8302-fce6434d096e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3" status: 200 len: 1681 microversion: 2.1 time: 0.186148 Aug 24 07:47:27.523602 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 416/822] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:47:27 2022] GET /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3 => generated 1681 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:47:27.752847 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-40d88ed0-fd9e-47ff-8ab8-394bac30b273 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:27.753612 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-40d88ed0-fd9e-47ff-8ab8-394bac30b273 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:27.759609 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-40d88ed0-fd9e-47ff-8ab8-394bac30b273 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:27.760089 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-40d88ed0-fd9e-47ff-8ab8-394bac30b273 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:27.760513 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-40d88ed0-fd9e-47ff-8ab8-394bac30b273 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:27.761249 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-40d88ed0-fd9e-47ff-8ab8-394bac30b273 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:27.761786 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-40d88ed0-fd9e-47ff-8ab8-394bac30b273 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:27.762556 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-40d88ed0-fd9e-47ff-8ab8-394bac30b273 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:28.001290 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-6f186a9d-21b7-4d59-bf98-64a3c0e0dd19 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:28.002049 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-6f186a9d-21b7-4d59-bf98-64a3c0e0dd19 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:28.007982 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6f186a9d-21b7-4d59-bf98-64a3c0e0dd19 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:28.008574 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6f186a9d-21b7-4d59-bf98-64a3c0e0dd19 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:28.009067 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6f186a9d-21b7-4d59-bf98-64a3c0e0dd19 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:28.009823 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6f186a9d-21b7-4d59-bf98-64a3c0e0dd19 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:28.010336 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6f186a9d-21b7-4d59-bf98-64a3c0e0dd19 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:28.010871 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6f186a9d-21b7-4d59-bf98-64a3c0e0dd19 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:28.030065 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-40d88ed0-fd9e-47ff-8ab8-394bac30b273 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:28.037962 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-40d88ed0-fd9e-47ff-8ab8-394bac30b273 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1566 microversion: 2.1 time: 0.291761 Aug 24 07:47:28.050725 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 407/823] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:47:27 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1566 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:47:28.193322 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-6f186a9d-21b7-4d59-bf98-64a3c0e0dd19 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:28.201950 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-6f186a9d-21b7-4d59-bf98-64a3c0e0dd19 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:28.203466 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-6f186a9d-21b7-4d59-bf98-64a3c0e0dd19 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:28.204792 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-6f186a9d-21b7-4d59-bf98-64a3c0e0dd19 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1809 microversion: 2.20 time: 0.208186 Aug 24 07:47:28.205337 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 417/824] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:47:27 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1809 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 07:47:28.544666 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-69fc1f9c-103b-485b-910a-98c15ad7309e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:28.545270 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-69fc1f9c-103b-485b-910a-98c15ad7309e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: ac3c9f36-8b18-45dd-b610-76ffb47d5ae3] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:28.552503 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-69fc1f9c-103b-485b-910a-98c15ad7309e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:28.553040 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-69fc1f9c-103b-485b-910a-98c15ad7309e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:28.553464 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-69fc1f9c-103b-485b-910a-98c15ad7309e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:28.554147 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-69fc1f9c-103b-485b-910a-98c15ad7309e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:28.554587 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-69fc1f9c-103b-485b-910a-98c15ad7309e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:28.555046 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-69fc1f9c-103b-485b-910a-98c15ad7309e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:28.621733 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-69fc1f9c-103b-485b-910a-98c15ad7309e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:28.629450 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-69fc1f9c-103b-485b-910a-98c15ad7309e tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3" status: 200 len: 1613 microversion: 2.1 time: 0.088589 Aug 24 07:47:28.630012 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 408/825] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:47:28 2022] GET /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3 => generated 1613 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:47:28.777254 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [req-69fe6784-e537-48d6-b3b7-5b7b9fe50367 req-5a91fab0-b085-4501-af15-f5a32156d3bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac3c9f36-8b18-45dd-b610-76ffb47d5ae3", "name": "network-vif-deleted", "tag": "17a47887-5c6a-4b79-966d-dadcb55f1b9c"}]} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:47:28.787783 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-69fe6784-e537-48d6-b3b7-5b7b9fe50367 req-5a91fab0-b085-4501-af15-f5a32156d3bb service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:28.788272 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-69fe6784-e537-48d6-b3b7-5b7b9fe50367 req-5a91fab0-b085-4501-af15-f5a32156d3bb service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:28.788849 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-69fe6784-e537-48d6-b3b7-5b7b9fe50367 req-5a91fab0-b085-4501-af15-f5a32156d3bb service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:28.807634 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.compute.server_external_events [req-69fe6784-e537-48d6-b3b7-5b7b9fe50367 req-5a91fab0-b085-4501-af15-f5a32156d3bb service nova] Creating event network-vif-deleted:17a47887-5c6a-4b79-966d-dadcb55f1b9c for instance ac3c9f36-8b18-45dd-b610-76ffb47d5ae3 on hv-cinder-85427 Aug 24 07:47:28.811743 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [req-69fe6784-e537-48d6-b3b7-5b7b9fe50367 req-5a91fab0-b085-4501-af15-f5a32156d3bb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038085 Aug 24 07:47:28.812788 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 418/826] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:47:29.064719 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-f0fa88a1-b430-42cd-8d91-39512c48fbd0 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:29.065419 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-f0fa88a1-b430-42cd-8d91-39512c48fbd0 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:29.071639 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f0fa88a1-b430-42cd-8d91-39512c48fbd0 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:29.072208 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f0fa88a1-b430-42cd-8d91-39512c48fbd0 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:29.072710 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f0fa88a1-b430-42cd-8d91-39512c48fbd0 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:29.073690 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f0fa88a1-b430-42cd-8d91-39512c48fbd0 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:29.074155 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f0fa88a1-b430-42cd-8d91-39512c48fbd0 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:29.074663 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f0fa88a1-b430-42cd-8d91-39512c48fbd0 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:29.216287 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-f0fa88a1-b430-42cd-8d91-39512c48fbd0 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:29.224538 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-f0fa88a1-b430-42cd-8d91-39512c48fbd0 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1566 microversion: 2.1 time: 0.163634 Aug 24 07:47:29.225107 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 409/827] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:47:29 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:47:29.227701 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-be059af8-c253-4583-9ab2-8b7c1f91fdff tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:29.228931 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-be059af8-c253-4583-9ab2-8b7c1f91fdff tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:29.236982 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-be059af8-c253-4583-9ab2-8b7c1f91fdff tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:29.237675 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-be059af8-c253-4583-9ab2-8b7c1f91fdff tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:29.238280 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-be059af8-c253-4583-9ab2-8b7c1f91fdff tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:29.239181 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-be059af8-c253-4583-9ab2-8b7c1f91fdff tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:29.239810 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-be059af8-c253-4583-9ab2-8b7c1f91fdff tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:29.240238 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-be059af8-c253-4583-9ab2-8b7c1f91fdff tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:29.387229 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-be059af8-c253-4583-9ab2-8b7c1f91fdff tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:29.397648 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-be059af8-c253-4583-9ab2-8b7c1f91fdff tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:29.399190 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-be059af8-c253-4583-9ab2-8b7c1f91fdff tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:29.400356 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-be059af8-c253-4583-9ab2-8b7c1f91fdff tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1809 microversion: 2.20 time: 0.177088 Aug 24 07:47:29.401049 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 419/828] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:47:29 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 07:47:29.649687 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-c6a00e6b-c6bb-462c-a97c-4eb1cd94dfb2 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:29.650303 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-c6a00e6b-c6bb-462c-a97c-4eb1cd94dfb2 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: ac3c9f36-8b18-45dd-b610-76ffb47d5ae3] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:29.659883 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c6a00e6b-c6bb-462c-a97c-4eb1cd94dfb2 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:29.660383 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c6a00e6b-c6bb-462c-a97c-4eb1cd94dfb2 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:29.660895 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c6a00e6b-c6bb-462c-a97c-4eb1cd94dfb2 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:29.661606 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c6a00e6b-c6bb-462c-a97c-4eb1cd94dfb2 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:29.662061 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c6a00e6b-c6bb-462c-a97c-4eb1cd94dfb2 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:29.662604 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c6a00e6b-c6bb-462c-a97c-4eb1cd94dfb2 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:29.697762 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c6a00e6b-c6bb-462c-a97c-4eb1cd94dfb2 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:29.698256 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c6a00e6b-c6bb-462c-a97c-4eb1cd94dfb2 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:29.698878 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c6a00e6b-c6bb-462c-a97c-4eb1cd94dfb2 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:29.699331 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.objects.instance [None req-c6a00e6b-c6bb-462c-a97c-4eb1cd94dfb2 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lazy-loading 'fault' on Instance uuid ac3c9f36-8b18-45dd-b610-76ffb47d5ae3 {{(pid=127113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:47:29.747383 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-c6a00e6b-c6bb-462c-a97c-4eb1cd94dfb2 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:29.760040 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-c6a00e6b-c6bb-462c-a97c-4eb1cd94dfb2 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3" status: 200 len: 1331 microversion: 2.1 time: 0.114020 Aug 24 07:47:29.760620 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 410/829] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:47:29 2022] GET /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3 => generated 1331 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:47:30.245132 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-08e8e57e-ac74-4383-a00d-b1ddfa68f6f2 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:30.245731 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-08e8e57e-ac74-4383-a00d-b1ddfa68f6f2 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:30.252045 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-08e8e57e-ac74-4383-a00d-b1ddfa68f6f2 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:30.252519 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-08e8e57e-ac74-4383-a00d-b1ddfa68f6f2 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:30.252945 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-08e8e57e-ac74-4383-a00d-b1ddfa68f6f2 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:30.253647 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-08e8e57e-ac74-4383-a00d-b1ddfa68f6f2 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:30.254092 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-08e8e57e-ac74-4383-a00d-b1ddfa68f6f2 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:30.254506 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-08e8e57e-ac74-4383-a00d-b1ddfa68f6f2 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:30.383688 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-08e8e57e-ac74-4383-a00d-b1ddfa68f6f2 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:30.392223 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-08e8e57e-ac74-4383-a00d-b1ddfa68f6f2 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1566 microversion: 2.1 time: 0.150878 Aug 24 07:47:30.392788 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 420/830] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:47:30 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:47:30.423265 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-e237a0f5-a6ef-40b4-b742-5f621908ec21 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:30.423793 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-e237a0f5-a6ef-40b4-b742-5f621908ec21 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:30.429575 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e237a0f5-a6ef-40b4-b742-5f621908ec21 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:30.430047 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e237a0f5-a6ef-40b4-b742-5f621908ec21 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:30.430473 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e237a0f5-a6ef-40b4-b742-5f621908ec21 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:30.431176 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e237a0f5-a6ef-40b4-b742-5f621908ec21 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:30.431626 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e237a0f5-a6ef-40b4-b742-5f621908ec21 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:30.432044 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e237a0f5-a6ef-40b4-b742-5f621908ec21 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:30.560087 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-e237a0f5-a6ef-40b4-b742-5f621908ec21 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:30.568647 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-e237a0f5-a6ef-40b4-b742-5f621908ec21 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:30.570154 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-e237a0f5-a6ef-40b4-b742-5f621908ec21 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:30.571328 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-e237a0f5-a6ef-40b4-b742-5f621908ec21 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1809 microversion: 2.20 time: 0.152337 Aug 24 07:47:30.571885 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 411/831] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:47:30 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:47:30.781045 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-01186384-c569-47c4-a965-e6efb2f0debe tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:30.781887 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-01186384-c569-47c4-a965-e6efb2f0debe tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: ac3c9f36-8b18-45dd-b610-76ffb47d5ae3] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:30.787801 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-01186384-c569-47c4-a965-e6efb2f0debe tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:30.788271 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-01186384-c569-47c4-a965-e6efb2f0debe tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:30.788702 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-01186384-c569-47c4-a965-e6efb2f0debe tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:30.789376 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-01186384-c569-47c4-a965-e6efb2f0debe tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:30.789821 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-01186384-c569-47c4-a965-e6efb2f0debe tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:30.790234 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-01186384-c569-47c4-a965-e6efb2f0debe tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:30.819868 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-01186384-c569-47c4-a965-e6efb2f0debe tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:30.820335 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-01186384-c569-47c4-a965-e6efb2f0debe tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:30.820761 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-01186384-c569-47c4-a965-e6efb2f0debe tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:30.821196 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.objects.instance [None req-01186384-c569-47c4-a965-e6efb2f0debe tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lazy-loading 'fault' on Instance uuid ac3c9f36-8b18-45dd-b610-76ffb47d5ae3 {{(pid=127114) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:47:30.860635 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-01186384-c569-47c4-a965-e6efb2f0debe tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:30.867967 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-01186384-c569-47c4-a965-e6efb2f0debe tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3" status: 200 len: 1331 microversion: 2.1 time: 0.090878 Aug 24 07:47:30.868523 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 421/832] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:47:30 2022] GET /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3 => generated 1331 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:47:31.416396 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-abcb5b4a-e81a-4d06-8f21-cd2f4b292c13 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:31.417006 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-abcb5b4a-e81a-4d06-8f21-cd2f4b292c13 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:31.424345 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-abcb5b4a-e81a-4d06-8f21-cd2f4b292c13 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:31.424776 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-abcb5b4a-e81a-4d06-8f21-cd2f4b292c13 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:31.425208 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-abcb5b4a-e81a-4d06-8f21-cd2f4b292c13 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:31.425893 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-abcb5b4a-e81a-4d06-8f21-cd2f4b292c13 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:31.426347 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-abcb5b4a-e81a-4d06-8f21-cd2f4b292c13 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:31.426798 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-abcb5b4a-e81a-4d06-8f21-cd2f4b292c13 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:31.556310 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-abcb5b4a-e81a-4d06-8f21-cd2f4b292c13 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:31.564392 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-abcb5b4a-e81a-4d06-8f21-cd2f4b292c13 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1566 microversion: 2.1 time: 0.151856 Aug 24 07:47:31.564978 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 412/833] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:47:31 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:47:31.593285 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-1dc516d2-9cd7-495c-b004-31f8f1841d5e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:31.594413 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-1dc516d2-9cd7-495c-b004-31f8f1841d5e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:31.600849 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1dc516d2-9cd7-495c-b004-31f8f1841d5e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:31.601324 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1dc516d2-9cd7-495c-b004-31f8f1841d5e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:31.601753 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1dc516d2-9cd7-495c-b004-31f8f1841d5e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:31.602436 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1dc516d2-9cd7-495c-b004-31f8f1841d5e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:31.602924 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1dc516d2-9cd7-495c-b004-31f8f1841d5e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:31.603379 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1dc516d2-9cd7-495c-b004-31f8f1841d5e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:31.731689 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-1dc516d2-9cd7-495c-b004-31f8f1841d5e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:31.740749 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-1dc516d2-9cd7-495c-b004-31f8f1841d5e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:31.742233 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-1dc516d2-9cd7-495c-b004-31f8f1841d5e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:31.743393 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-1dc516d2-9cd7-495c-b004-31f8f1841d5e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1809 microversion: 2.20 time: 0.154033 Aug 24 07:47:31.743945 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 422/834] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:47:31 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:47:31.889332 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-dd80a000-999f-41aa-90cc-8abe293de0ba tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:31.889935 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-dd80a000-999f-41aa-90cc-8abe293de0ba tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: ac3c9f36-8b18-45dd-b610-76ffb47d5ae3] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:31.896404 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-dd80a000-999f-41aa-90cc-8abe293de0ba tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:31.896892 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-dd80a000-999f-41aa-90cc-8abe293de0ba tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:31.897324 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-dd80a000-999f-41aa-90cc-8abe293de0ba tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:31.898010 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-dd80a000-999f-41aa-90cc-8abe293de0ba tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:31.898463 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-dd80a000-999f-41aa-90cc-8abe293de0ba tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:31.898914 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-dd80a000-999f-41aa-90cc-8abe293de0ba tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:31.930587 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-dd80a000-999f-41aa-90cc-8abe293de0ba tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:31.931086 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-dd80a000-999f-41aa-90cc-8abe293de0ba tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:31.931507 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-dd80a000-999f-41aa-90cc-8abe293de0ba tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:31.931943 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.objects.instance [None req-dd80a000-999f-41aa-90cc-8abe293de0ba tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lazy-loading 'fault' on Instance uuid ac3c9f36-8b18-45dd-b610-76ffb47d5ae3 {{(pid=127113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:47:31.972303 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-dd80a000-999f-41aa-90cc-8abe293de0ba tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f594c9344b2c472ba33ceef87ec88a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5acb73124c485aa87e60b4e5d4f6d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:31.979764 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-dd80a000-999f-41aa-90cc-8abe293de0ba tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3" status: 200 len: 1331 microversion: 2.1 time: 0.094352 Aug 24 07:47:31.980506 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 413/835] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:47:31 2022] GET /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3 => generated 1331 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:47:32.585862 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-da43d591-ca04-45de-9385-9cd085583de1 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:32.586801 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-da43d591-ca04-45de-9385-9cd085583de1 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:32.593843 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-da43d591-ca04-45de-9385-9cd085583de1 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:32.594392 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-da43d591-ca04-45de-9385-9cd085583de1 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:32.594798 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-da43d591-ca04-45de-9385-9cd085583de1 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:32.595490 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-da43d591-ca04-45de-9385-9cd085583de1 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:32.595969 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-da43d591-ca04-45de-9385-9cd085583de1 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:32.596387 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-da43d591-ca04-45de-9385-9cd085583de1 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:32.724275 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-da43d591-ca04-45de-9385-9cd085583de1 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:32.731978 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-da43d591-ca04-45de-9385-9cd085583de1 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1566 microversion: 2.1 time: 0.150230 Aug 24 07:47:32.732539 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 423/836] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:47:32 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:47:32.765158 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-60154cab-e604-4913-8f4f-f6892cab2672 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:32.767392 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-60154cab-e604-4913-8f4f-f6892cab2672 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:32.773955 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-60154cab-e604-4913-8f4f-f6892cab2672 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:32.774476 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-60154cab-e604-4913-8f4f-f6892cab2672 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:32.774988 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-60154cab-e604-4913-8f4f-f6892cab2672 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:32.775714 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-60154cab-e604-4913-8f4f-f6892cab2672 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:32.776200 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-60154cab-e604-4913-8f4f-f6892cab2672 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:32.776652 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-60154cab-e604-4913-8f4f-f6892cab2672 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:32.907447 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-60154cab-e604-4913-8f4f-f6892cab2672 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:32.915986 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-60154cab-e604-4913-8f4f-f6892cab2672 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:32.917481 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-60154cab-e604-4913-8f4f-f6892cab2672 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:32.918626 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-60154cab-e604-4913-8f4f-f6892cab2672 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1796 microversion: 2.20 time: 0.157311 Aug 24 07:47:32.919200 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 414/837] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:47:32 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1796 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:47:33.000579 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-fff3f8bf-6ccc-4b2d-8da7-c9d9ec50f479 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:33.001202 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-fff3f8bf-6ccc-4b2d-8da7-c9d9ec50f479 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: ac3c9f36-8b18-45dd-b610-76ffb47d5ae3] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:33.007133 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fff3f8bf-6ccc-4b2d-8da7-c9d9ec50f479 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:33.007608 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fff3f8bf-6ccc-4b2d-8da7-c9d9ec50f479 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:33.008036 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fff3f8bf-6ccc-4b2d-8da7-c9d9ec50f479 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:33.008714 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fff3f8bf-6ccc-4b2d-8da7-c9d9ec50f479 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:33.009164 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fff3f8bf-6ccc-4b2d-8da7-c9d9ec50f479 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:33.009581 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fff3f8bf-6ccc-4b2d-8da7-c9d9ec50f479 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:33.023028 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.wsgi [None req-fff3f8bf-6ccc-4b2d-8da7-c9d9ec50f479 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] HTTP exception thrown: Instance ac3c9f36-8b18-45dd-b610-76ffb47d5ae3 could not be found. Aug 24 07:47:33.024657 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-fff3f8bf-6ccc-4b2d-8da7-c9d9ec50f479 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Request method failure captured: Aug 24 07:47:33.024657 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: request: GET /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3 HTTP/1.1 Aug 24 07:47:33.024657 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept: application/json Aug 24 07:47:33.024657 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept-Encoding: identity Aug 24 07:47:33.024657 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Connection: close Aug 24 07:47:33.024657 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Length: 0 Aug 24 07:47:33.024657 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Type: application/json Aug 24 07:47:33.024657 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Host: 10.222.0.42 Aug 24 07:47:33.024657 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Openstack-System-Scope: None Aug 24 07:47:33.024657 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: User-Agent: python-urllib3/1.26.11 Aug 24 07:47:33.024657 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Auth-Token: gAAAAABjBdYobzFKkpFZErKGYQQ6C-XEh7i9OW8ojTbqxPVr74lckpRiFaze-efBQslsaQSX_M9uiYyghTqG7Fg_jrM-qOMOyzErIrVcNm0xIs9NgJg7VzKqJCSA-yXxsyHfCdfoLwTQ2cusI7TmXO58zoZh7YF2Ykkf3m7e8LiRBBQiO6NdfF4 Aug 24 07:47:33.024657 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Id: None Aug 24 07:47:33.024657 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Name: None Aug 24 07:47:33.024657 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Identity-Status: Confirmed Aug 24 07:47:33.024657 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Is-Admin-Project: True Aug 24 07:47:33.024657 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Id: default Aug 24 07:47:33.024657 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Name: Default Aug 24 07:47:33.024657 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Id: af5acb73124c485aa87e60b4e5d4f6d4 Aug 24 07:47:33.024657 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Name: tempest-AttachVolumeNegativeTest-1077633228 Aug 24 07:47:33.024657 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Role: reader,member Aug 24 07:47:33.024657 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Roles: reader,member Aug 24 07:47:33.026254 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af5acb73124c485aa87e60b4e5d4f6d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_af5acb73124c485aa87e60b4e5d4f6d4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af5acb73124c485aa87e60b4e5d4f6d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/af5acb73124c485aa87e60b4e5d4f6d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:47:33.026254 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant: tempest-AttachVolumeNegativeTest-1077633228 Aug 24 07:47:33.026254 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Id: af5acb73124c485aa87e60b4e5d4f6d4 Aug 24 07:47:33.026254 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1077633228 Aug 24 07:47:33.026254 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User: tempest-AttachVolumeNegativeTest-1077633228-project Aug 24 07:47:33.026254 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Id: default Aug 24 07:47:33.026254 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Name: Default Aug 24 07:47:33.026254 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Id: f594c9344b2c472ba33ceef87ec88a0b Aug 24 07:47:33.026254 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Name: tempest-AttachVolumeNegativeTest-1077633228-project Aug 24 07:47:33.026254 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: method: > Aug 24 07:47:33.026254 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: exception: Instance ac3c9f36-8b18-45dd-b610-76ffb47d5ae3 could not be found. Aug 24 07:47:33.026254 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: action_args: {'id': 'ac3c9f36-8b18-45dd-b610-76ffb47d5ae3'} Aug 24 07:47:33.027172 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:47:33.027172 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:47:33.027172 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:47:33.027172 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:47:33.027172 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:47:33.027172 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:47:33.027172 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:47:33.027172 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:47:33.027172 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:47:33.027172 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:47:33.027172 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac3c9f36-8b18-45dd-b610-76ffb47d5ae3 could not be found. Aug 24 07:47:33.027172 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:47:33.027172 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:47:33.027172 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:47:33.027172 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:47:33.027172 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:47:33.027172 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:47:33.027172 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:47:33.027172 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:47:33.027172 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:47:33.028684 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:47:33.028684 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 07:47:33.028684 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 07:47:33.028684 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:47:33.028684 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:47:33.028684 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:47:33.028684 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:47:33.028684 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac3c9f36-8b18-45dd-b610-76ffb47d5ae3 could not be found. Aug 24 07:47:33.028684 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:47:33.028684 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:47:33.028684 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:47:33.028684 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:47:33.028684 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:47:33.028684 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:47:33.028684 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:47:33.028684 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:47:33.028684 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac3c9f36-8b18-45dd-b610-76ffb47d5ae3 could not be found. Aug 24 07:47:33.028684 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:47:33.030086 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-fff3f8bf-6ccc-4b2d-8da7-c9d9ec50f479 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Returning 404 to user: Instance ac3c9f36-8b18-45dd-b610-76ffb47d5ae3 could not be found. {{(pid=127114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:47:33.030086 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-fff3f8bf-6ccc-4b2d-8da7-c9d9ec50f479 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3" status: 404 len: 111 microversion: 2.1 time: 0.029828 Aug 24 07:47:33.030086 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 424/838] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:47:32 2022] GET /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:47:33.034596 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-2e5fe876-261c-43ee-bb46-9408e4c5ac05 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '.version_select at 0x7faf5bc24430>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:33.053181 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-2e5fe876-261c-43ee-bb46-9408e4c5ac05 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1467060365" status: 202 len: 0 microversion: 2.1 time: 0.022310 Aug 24 07:47:33.053705 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 415/839] 10.222.0.42 () {58 vars in 1221 bytes} [Wed Aug 24 07:47:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1467060365 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 07:47:33.753528 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-c9385886-21b1-436a-8aa3-f407ab527df6 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:33.754144 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-c9385886-21b1-436a-8aa3-f407ab527df6 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:33.760568 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c9385886-21b1-436a-8aa3-f407ab527df6 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:33.761043 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c9385886-21b1-436a-8aa3-f407ab527df6 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:33.761468 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c9385886-21b1-436a-8aa3-f407ab527df6 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:33.762155 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c9385886-21b1-436a-8aa3-f407ab527df6 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:33.762605 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c9385886-21b1-436a-8aa3-f407ab527df6 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:33.763056 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c9385886-21b1-436a-8aa3-f407ab527df6 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:34.044858 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-c9385886-21b1-436a-8aa3-f407ab527df6 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:34.047943 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:34.054714 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-c9385886-21b1-436a-8aa3-f407ab527df6 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1566 microversion: 2.1 time: 0.305796 Aug 24 07:47:34.055282 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 425/840] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:47:33 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1566 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:47:35.075608 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-d379fca7-7669-4f29-b65c-3badf933cc63 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:35.076197 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-d379fca7-7669-4f29-b65c-3badf933cc63 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:35.082572 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d379fca7-7669-4f29-b65c-3badf933cc63 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:35.083157 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d379fca7-7669-4f29-b65c-3badf933cc63 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:35.083596 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d379fca7-7669-4f29-b65c-3badf933cc63 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:35.084279 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d379fca7-7669-4f29-b65c-3badf933cc63 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:35.084736 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d379fca7-7669-4f29-b65c-3badf933cc63 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:35.085156 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d379fca7-7669-4f29-b65c-3badf933cc63 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:35.245329 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-d379fca7-7669-4f29-b65c-3badf933cc63 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:35.247649 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:35.255520 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-d379fca7-7669-4f29-b65c-3badf933cc63 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1566 microversion: 2.1 time: 0.183710 Aug 24 07:47:35.256092 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 416/841] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:47:35 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1566 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:47:35.885843 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-9b03d8fb-a834-4119-bfc7-1eb14cf48840 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:35.886341 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-9b03d8fb-a834-4119-bfc7-1eb14cf48840 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: ac3c9f36-8b18-45dd-b610-76ffb47d5ae3] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:35.894303 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9b03d8fb-a834-4119-bfc7-1eb14cf48840 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:35.894810 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9b03d8fb-a834-4119-bfc7-1eb14cf48840 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:35.895248 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9b03d8fb-a834-4119-bfc7-1eb14cf48840 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:35.895936 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9b03d8fb-a834-4119-bfc7-1eb14cf48840 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:35.896421 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9b03d8fb-a834-4119-bfc7-1eb14cf48840 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:35.896811 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9b03d8fb-a834-4119-bfc7-1eb14cf48840 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:35.910483 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.wsgi [None req-9b03d8fb-a834-4119-bfc7-1eb14cf48840 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] HTTP exception thrown: Instance ac3c9f36-8b18-45dd-b610-76ffb47d5ae3 could not be found. Aug 24 07:47:35.912059 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-9b03d8fb-a834-4119-bfc7-1eb14cf48840 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Request method failure captured: Aug 24 07:47:35.912059 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: request: DELETE /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3 HTTP/1.1 Aug 24 07:47:35.912059 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept: application/json Aug 24 07:47:35.912059 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept-Encoding: identity Aug 24 07:47:35.912059 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Connection: close Aug 24 07:47:35.912059 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Length: 0 Aug 24 07:47:35.912059 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Type: application/json Aug 24 07:47:35.912059 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Host: 10.222.0.42 Aug 24 07:47:35.912059 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Openstack-System-Scope: None Aug 24 07:47:35.912059 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: User-Agent: python-urllib3/1.26.11 Aug 24 07:47:35.912059 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Auth-Token: gAAAAABjBdYobzFKkpFZErKGYQQ6C-XEh7i9OW8ojTbqxPVr74lckpRiFaze-efBQslsaQSX_M9uiYyghTqG7Fg_jrM-qOMOyzErIrVcNm0xIs9NgJg7VzKqJCSA-yXxsyHfCdfoLwTQ2cusI7TmXO58zoZh7YF2Ykkf3m7e8LiRBBQiO6NdfF4 Aug 24 07:47:35.912059 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Id: None Aug 24 07:47:35.912059 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Name: None Aug 24 07:47:35.912059 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Identity-Status: Confirmed Aug 24 07:47:35.912059 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Is-Admin-Project: True Aug 24 07:47:35.912059 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Id: default Aug 24 07:47:35.912059 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Name: Default Aug 24 07:47:35.912059 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Id: af5acb73124c485aa87e60b4e5d4f6d4 Aug 24 07:47:35.912059 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Name: tempest-AttachVolumeNegativeTest-1077633228 Aug 24 07:47:35.912059 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Role: reader,member Aug 24 07:47:35.912059 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Roles: reader,member Aug 24 07:47:35.913574 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af5acb73124c485aa87e60b4e5d4f6d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_af5acb73124c485aa87e60b4e5d4f6d4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af5acb73124c485aa87e60b4e5d4f6d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/af5acb73124c485aa87e60b4e5d4f6d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:47:35.913574 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant: tempest-AttachVolumeNegativeTest-1077633228 Aug 24 07:47:35.913574 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Id: af5acb73124c485aa87e60b4e5d4f6d4 Aug 24 07:47:35.913574 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1077633228 Aug 24 07:47:35.913574 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User: tempest-AttachVolumeNegativeTest-1077633228-project Aug 24 07:47:35.913574 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Id: default Aug 24 07:47:35.913574 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Name: Default Aug 24 07:47:35.913574 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Id: f594c9344b2c472ba33ceef87ec88a0b Aug 24 07:47:35.913574 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Name: tempest-AttachVolumeNegativeTest-1077633228-project Aug 24 07:47:35.913574 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: method: > Aug 24 07:47:35.913574 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: exception: Instance ac3c9f36-8b18-45dd-b610-76ffb47d5ae3 could not be found. Aug 24 07:47:35.913574 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: action_args: {'id': 'ac3c9f36-8b18-45dd-b610-76ffb47d5ae3'} Aug 24 07:47:35.914404 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:47:35.914404 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:47:35.914404 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:47:35.914404 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:47:35.914404 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:47:35.914404 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:47:35.914404 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:47:35.914404 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:47:35.914404 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:47:35.914404 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:47:35.914404 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac3c9f36-8b18-45dd-b610-76ffb47d5ae3 could not be found. Aug 24 07:47:35.914404 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:47:35.914404 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:47:35.914404 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:47:35.914404 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:47:35.914404 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:47:35.914404 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:47:35.914404 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:47:35.914404 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:47:35.914404 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:47:35.915919 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:47:35.915919 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 07:47:35.915919 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 07:47:35.915919 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 07:47:35.915919 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 07:47:35.915919 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:47:35.915919 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:47:35.915919 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:47:35.915919 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:47:35.915919 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac3c9f36-8b18-45dd-b610-76ffb47d5ae3 could not be found. Aug 24 07:47:35.915919 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:47:35.915919 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:47:35.915919 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:47:35.915919 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:47:35.915919 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:47:35.915919 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:47:35.915919 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:47:35.915919 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:47:35.915919 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac3c9f36-8b18-45dd-b610-76ffb47d5ae3 could not be found. Aug 24 07:47:35.915919 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:47:35.917616 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-9b03d8fb-a834-4119-bfc7-1eb14cf48840 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Returning 404 to user: Instance ac3c9f36-8b18-45dd-b610-76ffb47d5ae3 could not be found. {{(pid=127114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:47:35.917616 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-9b03d8fb-a834-4119-bfc7-1eb14cf48840 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3" status: 404 len: 111 microversion: 2.1 time: 0.031425 Aug 24 07:47:35.917616 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 426/842] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 24 07:47:35 2022] DELETE /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 07:47:35.922646 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-bcbfcd9c-3f01-43c6-a931-5ffc4717749c tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:35.923372 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-bcbfcd9c-3f01-43c6-a931-5ffc4717749c tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: ac3c9f36-8b18-45dd-b610-76ffb47d5ae3] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:35.929773 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bcbfcd9c-3f01-43c6-a931-5ffc4717749c tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:35.930255 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bcbfcd9c-3f01-43c6-a931-5ffc4717749c tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:35.930677 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bcbfcd9c-3f01-43c6-a931-5ffc4717749c tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:35.931371 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bcbfcd9c-3f01-43c6-a931-5ffc4717749c tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:35.931812 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bcbfcd9c-3f01-43c6-a931-5ffc4717749c tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:35.932228 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bcbfcd9c-3f01-43c6-a931-5ffc4717749c tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:35.945138 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.wsgi [None req-bcbfcd9c-3f01-43c6-a931-5ffc4717749c tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] HTTP exception thrown: Instance ac3c9f36-8b18-45dd-b610-76ffb47d5ae3 could not be found. Aug 24 07:47:35.946789 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-bcbfcd9c-3f01-43c6-a931-5ffc4717749c tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Request method failure captured: Aug 24 07:47:35.946789 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: request: GET /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3 HTTP/1.1 Aug 24 07:47:35.946789 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept: application/json Aug 24 07:47:35.946789 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept-Encoding: identity Aug 24 07:47:35.946789 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Connection: close Aug 24 07:47:35.946789 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Length: 0 Aug 24 07:47:35.946789 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Type: application/json Aug 24 07:47:35.946789 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Host: 10.222.0.42 Aug 24 07:47:35.946789 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Openstack-System-Scope: None Aug 24 07:47:35.946789 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: User-Agent: python-urllib3/1.26.11 Aug 24 07:47:35.946789 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Auth-Token: gAAAAABjBdYobzFKkpFZErKGYQQ6C-XEh7i9OW8ojTbqxPVr74lckpRiFaze-efBQslsaQSX_M9uiYyghTqG7Fg_jrM-qOMOyzErIrVcNm0xIs9NgJg7VzKqJCSA-yXxsyHfCdfoLwTQ2cusI7TmXO58zoZh7YF2Ykkf3m7e8LiRBBQiO6NdfF4 Aug 24 07:47:35.946789 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Id: None Aug 24 07:47:35.946789 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Name: None Aug 24 07:47:35.946789 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Identity-Status: Confirmed Aug 24 07:47:35.946789 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Is-Admin-Project: True Aug 24 07:47:35.946789 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Id: default Aug 24 07:47:35.946789 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Name: Default Aug 24 07:47:35.946789 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Id: af5acb73124c485aa87e60b4e5d4f6d4 Aug 24 07:47:35.946789 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Name: tempest-AttachVolumeNegativeTest-1077633228 Aug 24 07:47:35.946789 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Role: reader,member Aug 24 07:47:35.946789 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Roles: reader,member Aug 24 07:47:35.948334 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af5acb73124c485aa87e60b4e5d4f6d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_af5acb73124c485aa87e60b4e5d4f6d4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af5acb73124c485aa87e60b4e5d4f6d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/af5acb73124c485aa87e60b4e5d4f6d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:47:35.948334 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant: tempest-AttachVolumeNegativeTest-1077633228 Aug 24 07:47:35.948334 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Id: af5acb73124c485aa87e60b4e5d4f6d4 Aug 24 07:47:35.948334 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1077633228 Aug 24 07:47:35.948334 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User: tempest-AttachVolumeNegativeTest-1077633228-project Aug 24 07:47:35.948334 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Id: default Aug 24 07:47:35.948334 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Name: Default Aug 24 07:47:35.948334 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Id: f594c9344b2c472ba33ceef87ec88a0b Aug 24 07:47:35.948334 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Name: tempest-AttachVolumeNegativeTest-1077633228-project Aug 24 07:47:35.948334 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: method: > Aug 24 07:47:35.948334 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: exception: Instance ac3c9f36-8b18-45dd-b610-76ffb47d5ae3 could not be found. Aug 24 07:47:35.948334 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: action_args: {'id': 'ac3c9f36-8b18-45dd-b610-76ffb47d5ae3'} Aug 24 07:47:35.949133 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:47:35.949133 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:47:35.949133 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:47:35.949133 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:47:35.949133 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:47:35.949133 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:47:35.949133 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:47:35.949133 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:47:35.949133 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:47:35.949133 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:47:35.949133 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac3c9f36-8b18-45dd-b610-76ffb47d5ae3 could not be found. Aug 24 07:47:35.949133 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:47:35.949133 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:47:35.949133 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:47:35.949133 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:47:35.949133 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:47:35.949133 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:47:35.949133 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:47:35.949133 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:47:35.949133 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:47:35.950324 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:47:35.950324 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 07:47:35.950324 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 07:47:35.950324 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:47:35.950324 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:47:35.950324 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:47:35.950324 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:47:35.950324 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac3c9f36-8b18-45dd-b610-76ffb47d5ae3 could not be found. Aug 24 07:47:35.950324 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:47:35.950324 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:47:35.950324 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:47:35.950324 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:47:35.950324 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:47:35.950324 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:47:35.950324 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:47:35.950324 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:47:35.950324 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac3c9f36-8b18-45dd-b610-76ffb47d5ae3 could not be found. Aug 24 07:47:35.950324 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:47:35.951421 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-bcbfcd9c-3f01-43c6-a931-5ffc4717749c tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Returning 404 to user: Instance ac3c9f36-8b18-45dd-b610-76ffb47d5ae3 could not be found. {{(pid=127113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:47:35.951421 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-bcbfcd9c-3f01-43c6-a931-5ffc4717749c tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3" status: 404 len: 111 microversion: 2.1 time: 0.029641 Aug 24 07:47:35.951421 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 417/843] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:47:35 2022] GET /compute/v2.1/servers/ac3c9f36-8b18-45dd-b610-76ffb47d5ae3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:47:36.275461 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-f728846d-8b99-4f99-a4bd-be82c92f3958 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:36.276070 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-f728846d-8b99-4f99-a4bd-be82c92f3958 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:36.282097 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f728846d-8b99-4f99-a4bd-be82c92f3958 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:36.282828 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f728846d-8b99-4f99-a4bd-be82c92f3958 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:36.283335 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f728846d-8b99-4f99-a4bd-be82c92f3958 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:36.283960 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f728846d-8b99-4f99-a4bd-be82c92f3958 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:36.284468 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f728846d-8b99-4f99-a4bd-be82c92f3958 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:36.284915 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f728846d-8b99-4f99-a4bd-be82c92f3958 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:36.416695 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-f728846d-8b99-4f99-a4bd-be82c92f3958 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:36.425098 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-f728846d-8b99-4f99-a4bd-be82c92f3958 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1566 microversion: 2.1 time: 0.153403 Aug 24 07:47:36.425652 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 427/844] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:47:36 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:47:37.085529 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-46e6528d-e753-4f60-b1e7-db158c73eec9 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:37.086044 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-46e6528d-e753-4f60-b1e7-db158c73eec9 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: b0139656-99b6-4568-8fc1-61ac16df46d1] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:37.092295 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-46e6528d-e753-4f60-b1e7-db158c73eec9 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:37.092767 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-46e6528d-e753-4f60-b1e7-db158c73eec9 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:37.093191 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-46e6528d-e753-4f60-b1e7-db158c73eec9 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:37.093873 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-46e6528d-e753-4f60-b1e7-db158c73eec9 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:37.094316 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-46e6528d-e753-4f60-b1e7-db158c73eec9 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:37.094749 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-46e6528d-e753-4f60-b1e7-db158c73eec9 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:37.110862 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.wsgi [None req-46e6528d-e753-4f60-b1e7-db158c73eec9 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] HTTP exception thrown: Instance b0139656-99b6-4568-8fc1-61ac16df46d1 could not be found. Aug 24 07:47:37.112567 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-46e6528d-e753-4f60-b1e7-db158c73eec9 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Request method failure captured: Aug 24 07:47:37.112567 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: request: DELETE /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1 HTTP/1.1 Aug 24 07:47:37.112567 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept: application/json Aug 24 07:47:37.112567 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept-Encoding: identity Aug 24 07:47:37.112567 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Connection: close Aug 24 07:47:37.112567 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Length: 0 Aug 24 07:47:37.112567 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Type: application/json Aug 24 07:47:37.112567 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Host: 10.222.0.42 Aug 24 07:47:37.112567 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Openstack-System-Scope: None Aug 24 07:47:37.112567 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: User-Agent: python-urllib3/1.26.11 Aug 24 07:47:37.112567 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Auth-Token: gAAAAABjBdYobzFKkpFZErKGYQQ6C-XEh7i9OW8ojTbqxPVr74lckpRiFaze-efBQslsaQSX_M9uiYyghTqG7Fg_jrM-qOMOyzErIrVcNm0xIs9NgJg7VzKqJCSA-yXxsyHfCdfoLwTQ2cusI7TmXO58zoZh7YF2Ykkf3m7e8LiRBBQiO6NdfF4 Aug 24 07:47:37.112567 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Id: None Aug 24 07:47:37.112567 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Name: None Aug 24 07:47:37.112567 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Identity-Status: Confirmed Aug 24 07:47:37.112567 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Is-Admin-Project: True Aug 24 07:47:37.112567 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Id: default Aug 24 07:47:37.112567 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Name: Default Aug 24 07:47:37.112567 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Id: af5acb73124c485aa87e60b4e5d4f6d4 Aug 24 07:47:37.112567 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Name: tempest-AttachVolumeNegativeTest-1077633228 Aug 24 07:47:37.112567 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Role: reader,member Aug 24 07:47:37.112567 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Roles: reader,member Aug 24 07:47:37.114477 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af5acb73124c485aa87e60b4e5d4f6d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_af5acb73124c485aa87e60b4e5d4f6d4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af5acb73124c485aa87e60b4e5d4f6d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/af5acb73124c485aa87e60b4e5d4f6d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:47:37.114477 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant: tempest-AttachVolumeNegativeTest-1077633228 Aug 24 07:47:37.114477 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Id: af5acb73124c485aa87e60b4e5d4f6d4 Aug 24 07:47:37.114477 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1077633228 Aug 24 07:47:37.114477 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User: tempest-AttachVolumeNegativeTest-1077633228-project Aug 24 07:47:37.114477 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Id: default Aug 24 07:47:37.114477 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Name: Default Aug 24 07:47:37.114477 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Id: f594c9344b2c472ba33ceef87ec88a0b Aug 24 07:47:37.114477 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Name: tempest-AttachVolumeNegativeTest-1077633228-project Aug 24 07:47:37.114477 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: method: > Aug 24 07:47:37.114477 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: exception: Instance b0139656-99b6-4568-8fc1-61ac16df46d1 could not be found. Aug 24 07:47:37.114477 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: action_args: {'id': 'b0139656-99b6-4568-8fc1-61ac16df46d1'} Aug 24 07:47:37.115504 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:47:37.115504 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:47:37.115504 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:47:37.115504 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:47:37.115504 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:47:37.115504 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:47:37.115504 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:47:37.115504 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:47:37.115504 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:47:37.115504 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:47:37.115504 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0139656-99b6-4568-8fc1-61ac16df46d1 could not be found. Aug 24 07:47:37.115504 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:47:37.115504 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:47:37.115504 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:47:37.115504 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:47:37.115504 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:47:37.115504 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:47:37.115504 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:47:37.115504 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:47:37.115504 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:47:37.116966 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:47:37.116966 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 07:47:37.116966 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 07:47:37.116966 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 07:47:37.116966 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 07:47:37.116966 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:47:37.116966 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:47:37.116966 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:47:37.116966 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:47:37.116966 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0139656-99b6-4568-8fc1-61ac16df46d1 could not be found. Aug 24 07:47:37.116966 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:47:37.116966 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:47:37.116966 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:47:37.116966 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:47:37.116966 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:47:37.116966 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:47:37.116966 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:47:37.116966 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:47:37.116966 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0139656-99b6-4568-8fc1-61ac16df46d1 could not be found. Aug 24 07:47:37.116966 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:47:37.118448 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-46e6528d-e753-4f60-b1e7-db158c73eec9 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Returning 404 to user: Instance b0139656-99b6-4568-8fc1-61ac16df46d1 could not be found. {{(pid=127113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:47:37.118448 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-46e6528d-e753-4f60-b1e7-db158c73eec9 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1" status: 404 len: 111 microversion: 2.1 time: 0.032386 Aug 24 07:47:37.118448 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 418/845] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 24 07:47:37 2022] DELETE /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:47:37.122849 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-bbdd9c38-e7e5-4e1e-801c-9914c0f3293d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:37.123458 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-bbdd9c38-e7e5-4e1e-801c-9914c0f3293d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: b0139656-99b6-4568-8fc1-61ac16df46d1] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:37.130372 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-bbdd9c38-e7e5-4e1e-801c-9914c0f3293d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:37.130881 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-bbdd9c38-e7e5-4e1e-801c-9914c0f3293d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:37.131317 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-bbdd9c38-e7e5-4e1e-801c-9914c0f3293d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:37.132001 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-bbdd9c38-e7e5-4e1e-801c-9914c0f3293d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:37.132453 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-bbdd9c38-e7e5-4e1e-801c-9914c0f3293d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:37.132873 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-bbdd9c38-e7e5-4e1e-801c-9914c0f3293d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:37.146284 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.wsgi [None req-bbdd9c38-e7e5-4e1e-801c-9914c0f3293d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] HTTP exception thrown: Instance b0139656-99b6-4568-8fc1-61ac16df46d1 could not be found. Aug 24 07:47:37.147836 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-bbdd9c38-e7e5-4e1e-801c-9914c0f3293d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Request method failure captured: Aug 24 07:47:37.147836 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: request: GET /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1 HTTP/1.1 Aug 24 07:47:37.147836 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept: application/json Aug 24 07:47:37.147836 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept-Encoding: identity Aug 24 07:47:37.147836 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Connection: close Aug 24 07:47:37.147836 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Length: 0 Aug 24 07:47:37.147836 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Type: application/json Aug 24 07:47:37.147836 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Host: 10.222.0.42 Aug 24 07:47:37.147836 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Openstack-System-Scope: None Aug 24 07:47:37.147836 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: User-Agent: python-urllib3/1.26.11 Aug 24 07:47:37.147836 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Auth-Token: gAAAAABjBdYobzFKkpFZErKGYQQ6C-XEh7i9OW8ojTbqxPVr74lckpRiFaze-efBQslsaQSX_M9uiYyghTqG7Fg_jrM-qOMOyzErIrVcNm0xIs9NgJg7VzKqJCSA-yXxsyHfCdfoLwTQ2cusI7TmXO58zoZh7YF2Ykkf3m7e8LiRBBQiO6NdfF4 Aug 24 07:47:37.147836 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Id: None Aug 24 07:47:37.147836 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Name: None Aug 24 07:47:37.147836 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Identity-Status: Confirmed Aug 24 07:47:37.147836 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Is-Admin-Project: True Aug 24 07:47:37.147836 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Id: default Aug 24 07:47:37.147836 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Name: Default Aug 24 07:47:37.147836 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Id: af5acb73124c485aa87e60b4e5d4f6d4 Aug 24 07:47:37.147836 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Name: tempest-AttachVolumeNegativeTest-1077633228 Aug 24 07:47:37.147836 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Role: reader,member Aug 24 07:47:37.147836 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Roles: reader,member Aug 24 07:47:37.149434 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af5acb73124c485aa87e60b4e5d4f6d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_af5acb73124c485aa87e60b4e5d4f6d4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af5acb73124c485aa87e60b4e5d4f6d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/af5acb73124c485aa87e60b4e5d4f6d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:47:37.149434 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant: tempest-AttachVolumeNegativeTest-1077633228 Aug 24 07:47:37.149434 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Id: af5acb73124c485aa87e60b4e5d4f6d4 Aug 24 07:47:37.149434 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1077633228 Aug 24 07:47:37.149434 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User: tempest-AttachVolumeNegativeTest-1077633228-project Aug 24 07:47:37.149434 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Id: default Aug 24 07:47:37.149434 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Name: Default Aug 24 07:47:37.149434 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Id: f594c9344b2c472ba33ceef87ec88a0b Aug 24 07:47:37.149434 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Name: tempest-AttachVolumeNegativeTest-1077633228-project Aug 24 07:47:37.149434 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: method: > Aug 24 07:47:37.149434 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: exception: Instance b0139656-99b6-4568-8fc1-61ac16df46d1 could not be found. Aug 24 07:47:37.149434 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: action_args: {'id': 'b0139656-99b6-4568-8fc1-61ac16df46d1'} Aug 24 07:47:37.150303 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:47:37.150303 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:47:37.150303 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:47:37.150303 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:47:37.150303 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:47:37.150303 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:47:37.150303 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:47:37.150303 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:47:37.150303 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:47:37.150303 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:47:37.150303 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0139656-99b6-4568-8fc1-61ac16df46d1 could not be found. Aug 24 07:47:37.150303 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:47:37.150303 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:47:37.150303 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:47:37.150303 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:47:37.150303 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:47:37.150303 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:47:37.150303 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:47:37.150303 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:47:37.150303 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:47:37.151838 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:47:37.151838 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 07:47:37.151838 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 07:47:37.151838 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:47:37.151838 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:47:37.151838 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:47:37.151838 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:47:37.151838 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0139656-99b6-4568-8fc1-61ac16df46d1 could not be found. Aug 24 07:47:37.151838 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:47:37.151838 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:47:37.151838 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:47:37.151838 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:47:37.151838 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:47:37.151838 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:47:37.151838 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:47:37.151838 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:47:37.151838 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0139656-99b6-4568-8fc1-61ac16df46d1 could not be found. Aug 24 07:47:37.151838 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:47:37.153066 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-bbdd9c38-e7e5-4e1e-801c-9914c0f3293d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Returning 404 to user: Instance b0139656-99b6-4568-8fc1-61ac16df46d1 could not be found. {{(pid=127114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:47:37.153066 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-bbdd9c38-e7e5-4e1e-801c-9914c0f3293d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1" status: 404 len: 111 microversion: 2.1 time: 0.030212 Aug 24 07:47:37.153066 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 428/846] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:47:37 2022] GET /compute/v2.1/servers/b0139656-99b6-4568-8fc1-61ac16df46d1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 07:47:37.158084 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-bf9e3058-c587-495f-870f-e7a0dd25e03d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:37.158571 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-bf9e3058-c587-495f-870f-e7a0dd25e03d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: 851572e6-8dda-401b-aab8-58fbe54a2b31] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:37.164648 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bf9e3058-c587-495f-870f-e7a0dd25e03d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:37.165133 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bf9e3058-c587-495f-870f-e7a0dd25e03d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:37.165549 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bf9e3058-c587-495f-870f-e7a0dd25e03d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:37.166229 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bf9e3058-c587-495f-870f-e7a0dd25e03d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:37.166680 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bf9e3058-c587-495f-870f-e7a0dd25e03d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:37.167130 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bf9e3058-c587-495f-870f-e7a0dd25e03d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:37.180980 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.wsgi [None req-bf9e3058-c587-495f-870f-e7a0dd25e03d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] HTTP exception thrown: Instance 851572e6-8dda-401b-aab8-58fbe54a2b31 could not be found. Aug 24 07:47:37.182619 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-bf9e3058-c587-495f-870f-e7a0dd25e03d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Request method failure captured: Aug 24 07:47:37.182619 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: request: DELETE /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31 HTTP/1.1 Aug 24 07:47:37.182619 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept: application/json Aug 24 07:47:37.182619 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept-Encoding: identity Aug 24 07:47:37.182619 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Connection: close Aug 24 07:47:37.182619 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Length: 0 Aug 24 07:47:37.182619 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Type: application/json Aug 24 07:47:37.182619 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Host: 10.222.0.42 Aug 24 07:47:37.182619 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Openstack-System-Scope: None Aug 24 07:47:37.182619 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: User-Agent: python-urllib3/1.26.11 Aug 24 07:47:37.182619 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Auth-Token: gAAAAABjBdYobzFKkpFZErKGYQQ6C-XEh7i9OW8ojTbqxPVr74lckpRiFaze-efBQslsaQSX_M9uiYyghTqG7Fg_jrM-qOMOyzErIrVcNm0xIs9NgJg7VzKqJCSA-yXxsyHfCdfoLwTQ2cusI7TmXO58zoZh7YF2Ykkf3m7e8LiRBBQiO6NdfF4 Aug 24 07:47:37.182619 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Id: None Aug 24 07:47:37.182619 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Name: None Aug 24 07:47:37.182619 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Identity-Status: Confirmed Aug 24 07:47:37.182619 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Is-Admin-Project: True Aug 24 07:47:37.182619 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Id: default Aug 24 07:47:37.182619 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Name: Default Aug 24 07:47:37.182619 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Id: af5acb73124c485aa87e60b4e5d4f6d4 Aug 24 07:47:37.182619 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Name: tempest-AttachVolumeNegativeTest-1077633228 Aug 24 07:47:37.182619 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Role: reader,member Aug 24 07:47:37.182619 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Roles: reader,member Aug 24 07:47:37.184173 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af5acb73124c485aa87e60b4e5d4f6d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_af5acb73124c485aa87e60b4e5d4f6d4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af5acb73124c485aa87e60b4e5d4f6d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/af5acb73124c485aa87e60b4e5d4f6d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:47:37.184173 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant: tempest-AttachVolumeNegativeTest-1077633228 Aug 24 07:47:37.184173 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Id: af5acb73124c485aa87e60b4e5d4f6d4 Aug 24 07:47:37.184173 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1077633228 Aug 24 07:47:37.184173 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User: tempest-AttachVolumeNegativeTest-1077633228-project Aug 24 07:47:37.184173 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Id: default Aug 24 07:47:37.184173 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Name: Default Aug 24 07:47:37.184173 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Id: f594c9344b2c472ba33ceef87ec88a0b Aug 24 07:47:37.184173 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Name: tempest-AttachVolumeNegativeTest-1077633228-project Aug 24 07:47:37.184173 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: method: > Aug 24 07:47:37.184173 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: exception: Instance 851572e6-8dda-401b-aab8-58fbe54a2b31 could not be found. Aug 24 07:47:37.184173 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: action_args: {'id': '851572e6-8dda-401b-aab8-58fbe54a2b31'} Aug 24 07:47:37.185107 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:47:37.185107 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:47:37.185107 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:47:37.185107 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:47:37.185107 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:47:37.185107 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:47:37.185107 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:47:37.185107 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:47:37.185107 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:47:37.185107 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:47:37.185107 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 851572e6-8dda-401b-aab8-58fbe54a2b31 could not be found. Aug 24 07:47:37.185107 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:47:37.185107 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:47:37.185107 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:47:37.185107 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:47:37.185107 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:47:37.185107 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:47:37.185107 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:47:37.185107 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:47:37.185107 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:47:37.186590 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:47:37.186590 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 07:47:37.186590 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 07:47:37.186590 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 07:47:37.186590 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 07:47:37.186590 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:47:37.186590 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:47:37.186590 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:47:37.186590 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:47:37.186590 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 851572e6-8dda-401b-aab8-58fbe54a2b31 could not be found. Aug 24 07:47:37.186590 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:47:37.186590 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:47:37.186590 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:47:37.186590 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:47:37.186590 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:47:37.186590 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:47:37.186590 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:47:37.186590 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:47:37.186590 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 851572e6-8dda-401b-aab8-58fbe54a2b31 could not be found. Aug 24 07:47:37.186590 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:47:37.188182 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-bf9e3058-c587-495f-870f-e7a0dd25e03d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Returning 404 to user: Instance 851572e6-8dda-401b-aab8-58fbe54a2b31 could not be found. {{(pid=127113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:47:37.188182 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-bf9e3058-c587-495f-870f-e7a0dd25e03d tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "DELETE /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31" status: 404 len: 111 microversion: 2.1 time: 0.030401 Aug 24 07:47:37.188182 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 419/847] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 24 07:47:37 2022] DELETE /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 07:47:37.192440 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-b322fb62-4cab-43c0-9a11-b2bd5f5eb083 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:37.193049 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-b322fb62-4cab-43c0-9a11-b2bd5f5eb083 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: 851572e6-8dda-401b-aab8-58fbe54a2b31] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:37.199018 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b322fb62-4cab-43c0-9a11-b2bd5f5eb083 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:37.199493 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b322fb62-4cab-43c0-9a11-b2bd5f5eb083 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:37.199921 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b322fb62-4cab-43c0-9a11-b2bd5f5eb083 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:37.200596 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b322fb62-4cab-43c0-9a11-b2bd5f5eb083 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:37.201043 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b322fb62-4cab-43c0-9a11-b2bd5f5eb083 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:37.201462 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b322fb62-4cab-43c0-9a11-b2bd5f5eb083 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:37.215078 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.wsgi [None req-b322fb62-4cab-43c0-9a11-b2bd5f5eb083 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] HTTP exception thrown: Instance 851572e6-8dda-401b-aab8-58fbe54a2b31 could not be found. Aug 24 07:47:37.216574 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-b322fb62-4cab-43c0-9a11-b2bd5f5eb083 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Request method failure captured: Aug 24 07:47:37.216574 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: request: GET /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31 HTTP/1.1 Aug 24 07:47:37.216574 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept: application/json Aug 24 07:47:37.216574 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept-Encoding: identity Aug 24 07:47:37.216574 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Connection: close Aug 24 07:47:37.216574 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Length: 0 Aug 24 07:47:37.216574 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Type: application/json Aug 24 07:47:37.216574 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Host: 10.222.0.42 Aug 24 07:47:37.216574 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Openstack-System-Scope: None Aug 24 07:47:37.216574 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: User-Agent: python-urllib3/1.26.11 Aug 24 07:47:37.216574 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Auth-Token: gAAAAABjBdYobzFKkpFZErKGYQQ6C-XEh7i9OW8ojTbqxPVr74lckpRiFaze-efBQslsaQSX_M9uiYyghTqG7Fg_jrM-qOMOyzErIrVcNm0xIs9NgJg7VzKqJCSA-yXxsyHfCdfoLwTQ2cusI7TmXO58zoZh7YF2Ykkf3m7e8LiRBBQiO6NdfF4 Aug 24 07:47:37.216574 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Id: None Aug 24 07:47:37.216574 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Name: None Aug 24 07:47:37.216574 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Identity-Status: Confirmed Aug 24 07:47:37.216574 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Is-Admin-Project: True Aug 24 07:47:37.216574 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Id: default Aug 24 07:47:37.216574 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Name: Default Aug 24 07:47:37.216574 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Id: af5acb73124c485aa87e60b4e5d4f6d4 Aug 24 07:47:37.216574 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Name: tempest-AttachVolumeNegativeTest-1077633228 Aug 24 07:47:37.216574 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Role: reader,member Aug 24 07:47:37.216574 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Roles: reader,member Aug 24 07:47:37.218201 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af5acb73124c485aa87e60b4e5d4f6d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_af5acb73124c485aa87e60b4e5d4f6d4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af5acb73124c485aa87e60b4e5d4f6d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/af5acb73124c485aa87e60b4e5d4f6d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:47:37.218201 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant: tempest-AttachVolumeNegativeTest-1077633228 Aug 24 07:47:37.218201 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Id: af5acb73124c485aa87e60b4e5d4f6d4 Aug 24 07:47:37.218201 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1077633228 Aug 24 07:47:37.218201 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User: tempest-AttachVolumeNegativeTest-1077633228-project Aug 24 07:47:37.218201 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Id: default Aug 24 07:47:37.218201 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Name: Default Aug 24 07:47:37.218201 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Id: f594c9344b2c472ba33ceef87ec88a0b Aug 24 07:47:37.218201 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Name: tempest-AttachVolumeNegativeTest-1077633228-project Aug 24 07:47:37.218201 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: method: > Aug 24 07:47:37.218201 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: exception: Instance 851572e6-8dda-401b-aab8-58fbe54a2b31 could not be found. Aug 24 07:47:37.218201 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: action_args: {'id': '851572e6-8dda-401b-aab8-58fbe54a2b31'} Aug 24 07:47:37.219974 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:47:37.219974 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:47:37.219974 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:47:37.219974 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:47:37.219974 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:47:37.219974 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:47:37.219974 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:47:37.219974 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:47:37.219974 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:47:37.219974 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:47:37.219974 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 851572e6-8dda-401b-aab8-58fbe54a2b31 could not be found. Aug 24 07:47:37.219974 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:47:37.219974 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:47:37.219974 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:47:37.219974 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:47:37.219974 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:47:37.219974 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:47:37.219974 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:47:37.219974 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:47:37.219974 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:47:37.221557 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:47:37.221557 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 07:47:37.221557 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 07:47:37.221557 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:47:37.221557 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:47:37.221557 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:47:37.221557 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:47:37.221557 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 851572e6-8dda-401b-aab8-58fbe54a2b31 could not be found. Aug 24 07:47:37.221557 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:47:37.221557 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:47:37.221557 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:47:37.221557 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:47:37.221557 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:47:37.221557 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:47:37.221557 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:47:37.221557 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:47:37.221557 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 851572e6-8dda-401b-aab8-58fbe54a2b31 could not be found. Aug 24 07:47:37.221557 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:47:37.223063 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-b322fb62-4cab-43c0-9a11-b2bd5f5eb083 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Returning 404 to user: Instance 851572e6-8dda-401b-aab8-58fbe54a2b31 could not be found. {{(pid=127114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:47:37.223063 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-b322fb62-4cab-43c0-9a11-b2bd5f5eb083 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31" status: 404 len: 111 microversion: 2.1 time: 0.029343 Aug 24 07:47:37.223063 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 429/848] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:47:37 2022] GET /compute/v2.1/servers/851572e6-8dda-401b-aab8-58fbe54a2b31 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:47:37.446546 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-a95a0d30-1738-4cb3-aa07-f781dcfdf270 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:37.447207 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-a95a0d30-1738-4cb3-aa07-f781dcfdf270 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:37.454083 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a95a0d30-1738-4cb3-aa07-f781dcfdf270 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:37.454557 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a95a0d30-1738-4cb3-aa07-f781dcfdf270 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:37.455023 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a95a0d30-1738-4cb3-aa07-f781dcfdf270 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:37.455703 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a95a0d30-1738-4cb3-aa07-f781dcfdf270 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:37.456147 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a95a0d30-1738-4cb3-aa07-f781dcfdf270 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:37.456559 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a95a0d30-1738-4cb3-aa07-f781dcfdf270 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:37.597557 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-a95a0d30-1738-4cb3-aa07-f781dcfdf270 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:37.605698 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-a95a0d30-1738-4cb3-aa07-f781dcfdf270 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1566 microversion: 2.1 time: 0.163381 Aug 24 07:47:37.606220 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 420/849] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:47:37 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:47:38.351874 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-8695fec5-4b51-459a-ac3f-8593b6f9cf83 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:38.352349 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-8695fec5-4b51-459a-ac3f-8593b6f9cf83 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: d596e142-eb18-49d4-8eb8-bec422282059] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:38.358704 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8695fec5-4b51-459a-ac3f-8593b6f9cf83 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:38.359191 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8695fec5-4b51-459a-ac3f-8593b6f9cf83 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:38.359616 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8695fec5-4b51-459a-ac3f-8593b6f9cf83 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:38.360289 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8695fec5-4b51-459a-ac3f-8593b6f9cf83 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:38.360730 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8695fec5-4b51-459a-ac3f-8593b6f9cf83 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:38.361142 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8695fec5-4b51-459a-ac3f-8593b6f9cf83 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:38.374038 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.wsgi [None req-8695fec5-4b51-459a-ac3f-8593b6f9cf83 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] HTTP exception thrown: Instance d596e142-eb18-49d4-8eb8-bec422282059 could not be found. Aug 24 07:47:38.376100 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-8695fec5-4b51-459a-ac3f-8593b6f9cf83 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Request method failure captured: Aug 24 07:47:38.376100 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: request: DELETE /compute/v2.1/servers/d596e142-eb18-49d4-8eb8-bec422282059 HTTP/1.1 Aug 24 07:47:38.376100 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept: application/json Aug 24 07:47:38.376100 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept-Encoding: identity Aug 24 07:47:38.376100 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Connection: close Aug 24 07:47:38.376100 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Length: 0 Aug 24 07:47:38.376100 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Type: application/json Aug 24 07:47:38.376100 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Host: 10.222.0.42 Aug 24 07:47:38.376100 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Openstack-System-Scope: None Aug 24 07:47:38.376100 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: User-Agent: python-urllib3/1.26.11 Aug 24 07:47:38.376100 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Auth-Token: gAAAAABjBdYobzFKkpFZErKGYQQ6C-XEh7i9OW8ojTbqxPVr74lckpRiFaze-efBQslsaQSX_M9uiYyghTqG7Fg_jrM-qOMOyzErIrVcNm0xIs9NgJg7VzKqJCSA-yXxsyHfCdfoLwTQ2cusI7TmXO58zoZh7YF2Ykkf3m7e8LiRBBQiO6NdfF4 Aug 24 07:47:38.376100 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Id: None Aug 24 07:47:38.376100 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Name: None Aug 24 07:47:38.376100 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Identity-Status: Confirmed Aug 24 07:47:38.376100 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Is-Admin-Project: True Aug 24 07:47:38.376100 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Id: default Aug 24 07:47:38.376100 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Name: Default Aug 24 07:47:38.376100 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Id: af5acb73124c485aa87e60b4e5d4f6d4 Aug 24 07:47:38.376100 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Name: tempest-AttachVolumeNegativeTest-1077633228 Aug 24 07:47:38.376100 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Role: reader,member Aug 24 07:47:38.376100 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Roles: reader,member Aug 24 07:47:38.377641 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af5acb73124c485aa87e60b4e5d4f6d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_af5acb73124c485aa87e60b4e5d4f6d4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af5acb73124c485aa87e60b4e5d4f6d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/af5acb73124c485aa87e60b4e5d4f6d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:47:38.377641 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant: tempest-AttachVolumeNegativeTest-1077633228 Aug 24 07:47:38.377641 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Id: af5acb73124c485aa87e60b4e5d4f6d4 Aug 24 07:47:38.377641 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1077633228 Aug 24 07:47:38.377641 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User: tempest-AttachVolumeNegativeTest-1077633228-project Aug 24 07:47:38.377641 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Id: default Aug 24 07:47:38.377641 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Name: Default Aug 24 07:47:38.377641 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Id: f594c9344b2c472ba33ceef87ec88a0b Aug 24 07:47:38.377641 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Name: tempest-AttachVolumeNegativeTest-1077633228-project Aug 24 07:47:38.377641 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: method: > Aug 24 07:47:38.377641 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: exception: Instance d596e142-eb18-49d4-8eb8-bec422282059 could not be found. Aug 24 07:47:38.377641 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: action_args: {'id': 'd596e142-eb18-49d4-8eb8-bec422282059'} Aug 24 07:47:38.378499 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:47:38.378499 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:47:38.378499 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:47:38.378499 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:47:38.378499 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:47:38.378499 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:47:38.378499 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:47:38.378499 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:47:38.378499 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:47:38.378499 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:47:38.378499 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d596e142-eb18-49d4-8eb8-bec422282059 could not be found. Aug 24 07:47:38.378499 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:47:38.378499 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:47:38.378499 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:47:38.378499 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:47:38.378499 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:47:38.378499 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:47:38.378499 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:47:38.378499 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:47:38.378499 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:47:38.379951 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:47:38.379951 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 07:47:38.379951 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 07:47:38.379951 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 07:47:38.379951 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 07:47:38.379951 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:47:38.379951 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:47:38.379951 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:47:38.379951 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:47:38.379951 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d596e142-eb18-49d4-8eb8-bec422282059 could not be found. Aug 24 07:47:38.379951 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:47:38.379951 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:47:38.379951 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:47:38.379951 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:47:38.379951 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:47:38.379951 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:47:38.379951 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:47:38.379951 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:47:38.379951 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d596e142-eb18-49d4-8eb8-bec422282059 could not be found. Aug 24 07:47:38.379951 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:47:38.381358 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-8695fec5-4b51-459a-ac3f-8593b6f9cf83 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Returning 404 to user: Instance d596e142-eb18-49d4-8eb8-bec422282059 could not be found. {{(pid=127114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:47:38.381358 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-8695fec5-4b51-459a-ac3f-8593b6f9cf83 tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d596e142-eb18-49d4-8eb8-bec422282059" status: 404 len: 111 microversion: 2.1 time: 0.029602 Aug 24 07:47:38.381358 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 430/850] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 24 07:47:38 2022] DELETE /compute/v2.1/servers/d596e142-eb18-49d4-8eb8-bec422282059 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:47:38.385839 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-00d2cb5c-25e3-46d1-9435-f836d87260bf tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:38.386438 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-00d2cb5c-25e3-46d1-9435-f836d87260bf tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] [instance: d596e142-eb18-49d4-8eb8-bec422282059] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:38.393768 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-00d2cb5c-25e3-46d1-9435-f836d87260bf tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:38.394237 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-00d2cb5c-25e3-46d1-9435-f836d87260bf tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:38.394665 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-00d2cb5c-25e3-46d1-9435-f836d87260bf tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:38.395368 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-00d2cb5c-25e3-46d1-9435-f836d87260bf tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:38.395809 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-00d2cb5c-25e3-46d1-9435-f836d87260bf tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:38.396226 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-00d2cb5c-25e3-46d1-9435-f836d87260bf tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:38.409473 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.wsgi [None req-00d2cb5c-25e3-46d1-9435-f836d87260bf tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] HTTP exception thrown: Instance d596e142-eb18-49d4-8eb8-bec422282059 could not be found. Aug 24 07:47:38.410997 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-00d2cb5c-25e3-46d1-9435-f836d87260bf tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Request method failure captured: Aug 24 07:47:38.410997 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: request: GET /compute/v2.1/servers/d596e142-eb18-49d4-8eb8-bec422282059 HTTP/1.1 Aug 24 07:47:38.410997 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept: application/json Aug 24 07:47:38.410997 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept-Encoding: identity Aug 24 07:47:38.410997 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Connection: close Aug 24 07:47:38.410997 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Length: 0 Aug 24 07:47:38.410997 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Type: application/json Aug 24 07:47:38.410997 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Host: 10.222.0.42 Aug 24 07:47:38.410997 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Openstack-System-Scope: None Aug 24 07:47:38.410997 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: User-Agent: python-urllib3/1.26.11 Aug 24 07:47:38.410997 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Auth-Token: gAAAAABjBdYobzFKkpFZErKGYQQ6C-XEh7i9OW8ojTbqxPVr74lckpRiFaze-efBQslsaQSX_M9uiYyghTqG7Fg_jrM-qOMOyzErIrVcNm0xIs9NgJg7VzKqJCSA-yXxsyHfCdfoLwTQ2cusI7TmXO58zoZh7YF2Ykkf3m7e8LiRBBQiO6NdfF4 Aug 24 07:47:38.410997 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Id: None Aug 24 07:47:38.410997 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Name: None Aug 24 07:47:38.410997 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Identity-Status: Confirmed Aug 24 07:47:38.410997 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Is-Admin-Project: True Aug 24 07:47:38.410997 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Id: default Aug 24 07:47:38.410997 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Name: Default Aug 24 07:47:38.410997 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Id: af5acb73124c485aa87e60b4e5d4f6d4 Aug 24 07:47:38.410997 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Name: tempest-AttachVolumeNegativeTest-1077633228 Aug 24 07:47:38.410997 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Role: reader,member Aug 24 07:47:38.410997 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Roles: reader,member Aug 24 07:47:38.412512 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af5acb73124c485aa87e60b4e5d4f6d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_af5acb73124c485aa87e60b4e5d4f6d4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af5acb73124c485aa87e60b4e5d4f6d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/af5acb73124c485aa87e60b4e5d4f6d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:47:38.412512 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant: tempest-AttachVolumeNegativeTest-1077633228 Aug 24 07:47:38.412512 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Id: af5acb73124c485aa87e60b4e5d4f6d4 Aug 24 07:47:38.412512 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1077633228 Aug 24 07:47:38.412512 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User: tempest-AttachVolumeNegativeTest-1077633228-project Aug 24 07:47:38.412512 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Id: default Aug 24 07:47:38.412512 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Name: Default Aug 24 07:47:38.412512 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Id: f594c9344b2c472ba33ceef87ec88a0b Aug 24 07:47:38.412512 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Name: tempest-AttachVolumeNegativeTest-1077633228-project Aug 24 07:47:38.412512 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: method: > Aug 24 07:47:38.412512 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: exception: Instance d596e142-eb18-49d4-8eb8-bec422282059 could not be found. Aug 24 07:47:38.412512 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: action_args: {'id': 'd596e142-eb18-49d4-8eb8-bec422282059'} Aug 24 07:47:38.413395 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:47:38.413395 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:47:38.413395 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:47:38.413395 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:47:38.413395 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:47:38.413395 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:47:38.413395 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:47:38.413395 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:47:38.413395 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:47:38.413395 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:47:38.413395 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d596e142-eb18-49d4-8eb8-bec422282059 could not be found. Aug 24 07:47:38.413395 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:47:38.413395 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:47:38.413395 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:47:38.413395 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:47:38.413395 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:47:38.413395 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:47:38.413395 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:47:38.413395 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:47:38.413395 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:47:38.414871 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:47:38.414871 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 07:47:38.414871 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 07:47:38.414871 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:47:38.414871 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:47:38.414871 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:47:38.414871 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:47:38.414871 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d596e142-eb18-49d4-8eb8-bec422282059 could not be found. Aug 24 07:47:38.414871 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:47:38.414871 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:47:38.414871 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:47:38.414871 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:47:38.414871 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:47:38.414871 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:47:38.414871 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:47:38.414871 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:47:38.414871 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d596e142-eb18-49d4-8eb8-bec422282059 could not be found. Aug 24 07:47:38.414871 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:47:38.416187 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-00d2cb5c-25e3-46d1-9435-f836d87260bf tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] Returning 404 to user: Instance d596e142-eb18-49d4-8eb8-bec422282059 could not be found. {{(pid=127113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:47:38.416187 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-00d2cb5c-25e3-46d1-9435-f836d87260bf tempest-AttachVolumeNegativeTest-1077633228 tempest-AttachVolumeNegativeTest-1077633228-project] 10.222.0.42 "GET /compute/v2.1/servers/d596e142-eb18-49d4-8eb8-bec422282059" status: 404 len: 111 microversion: 2.1 time: 0.030272 Aug 24 07:47:38.416187 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 421/851] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:47:38 2022] GET /compute/v2.1/servers/d596e142-eb18-49d4-8eb8-bec422282059 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:47:38.626588 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-926b8a62-3aa7-47e5-adb2-8614631ad236 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:38.627268 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-926b8a62-3aa7-47e5-adb2-8614631ad236 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:38.633079 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-926b8a62-3aa7-47e5-adb2-8614631ad236 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:38.633559 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-926b8a62-3aa7-47e5-adb2-8614631ad236 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:38.633988 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-926b8a62-3aa7-47e5-adb2-8614631ad236 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:38.634666 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-926b8a62-3aa7-47e5-adb2-8614631ad236 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:38.635140 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-926b8a62-3aa7-47e5-adb2-8614631ad236 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:38.635563 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-926b8a62-3aa7-47e5-adb2-8614631ad236 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:38.762331 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-926b8a62-3aa7-47e5-adb2-8614631ad236 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:38.771017 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-926b8a62-3aa7-47e5-adb2-8614631ad236 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1507 microversion: 2.1 time: 0.148083 Aug 24 07:47:38.772075 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 431/852] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:47:38 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:47:38.792084 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-afcad62c-f98c-41a3-bab7-69b8c8f0adf6 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:47:38.792778 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-afcad62c-f98c-41a3-bab7-69b8c8f0adf6 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:38.798999 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-afcad62c-f98c-41a3-bab7-69b8c8f0adf6 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:38.799473 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-afcad62c-f98c-41a3-bab7-69b8c8f0adf6 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:38.799899 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-afcad62c-f98c-41a3-bab7-69b8c8f0adf6 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:38.800579 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-afcad62c-f98c-41a3-bab7-69b8c8f0adf6 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:38.801025 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-afcad62c-f98c-41a3-bab7-69b8c8f0adf6 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:38.801439 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-afcad62c-f98c-41a3-bab7-69b8c8f0adf6 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:38.846375 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-afcad62c-f98c-41a3-bab7-69b8c8f0adf6 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127113) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 07:47:38.915215 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-afcad62c-f98c-41a3-bab7-69b8c8f0adf6 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "POST /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647/action" status: 202 len: 0 microversion: 2.1 time: 0.126901 Aug 24 07:47:38.916148 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 422/853] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Aug 24 07:47:38 2022] POST /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 07:47:38.924612 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-01d6da09-6520-45bc-9a9f-a437e5feee2f tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:38.925634 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-01d6da09-6520-45bc-9a9f-a437e5feee2f tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:38.928259 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:38.936391 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-01d6da09-6520-45bc-9a9f-a437e5feee2f tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:38.936976 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-01d6da09-6520-45bc-9a9f-a437e5feee2f tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:38.937503 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-01d6da09-6520-45bc-9a9f-a437e5feee2f tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:38.938427 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-01d6da09-6520-45bc-9a9f-a437e5feee2f tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:38.938980 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-01d6da09-6520-45bc-9a9f-a437e5feee2f tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:38.939636 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-01d6da09-6520-45bc-9a9f-a437e5feee2f tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:39.133733 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-01d6da09-6520-45bc-9a9f-a437e5feee2f tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:39.141545 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-01d6da09-6520-45bc-9a9f-a437e5feee2f tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1515 microversion: 2.1 time: 0.221096 Aug 24 07:47:39.142106 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 432/854] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:47:38 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1515 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:47:40.163929 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-f7d5b9a5-c1d1-450a-9f58-c63893d6d165 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:40.164607 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-f7d5b9a5-c1d1-450a-9f58-c63893d6d165 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:40.166455 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:47:40.172689 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f7d5b9a5-c1d1-450a-9f58-c63893d6d165 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:40.173169 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f7d5b9a5-c1d1-450a-9f58-c63893d6d165 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:40.173592 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f7d5b9a5-c1d1-450a-9f58-c63893d6d165 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:40.174274 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f7d5b9a5-c1d1-450a-9f58-c63893d6d165 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:40.174802 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f7d5b9a5-c1d1-450a-9f58-c63893d6d165 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:40.175220 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f7d5b9a5-c1d1-450a-9f58-c63893d6d165 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:40.405051 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-f7d5b9a5-c1d1-450a-9f58-c63893d6d165 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:40.413226 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-f7d5b9a5-c1d1-450a-9f58-c63893d6d165 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1515 microversion: 2.1 time: 0.254252 Aug 24 07:47:40.413877 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 423/855] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:47:40 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1515 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:47:41.435049 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-c78177c7-8c2b-4148-a2f1-07b30b7549a4 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:41.435691 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-c78177c7-8c2b-4148-a2f1-07b30b7549a4 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:41.454023 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c78177c7-8c2b-4148-a2f1-07b30b7549a4 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:41.454543 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c78177c7-8c2b-4148-a2f1-07b30b7549a4 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:41.455018 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c78177c7-8c2b-4148-a2f1-07b30b7549a4 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:41.459158 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c78177c7-8c2b-4148-a2f1-07b30b7549a4 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:41.461677 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c78177c7-8c2b-4148-a2f1-07b30b7549a4 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:41.462346 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c78177c7-8c2b-4148-a2f1-07b30b7549a4 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:41.757686 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-c78177c7-8c2b-4148-a2f1-07b30b7549a4 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:41.772605 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-c78177c7-8c2b-4148-a2f1-07b30b7549a4 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1517 microversion: 2.1 time: 0.339298 Aug 24 07:47:41.783418 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 433/856] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:47:41 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1517 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:47:41.991809 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [req-99a1da6d-9917-41d7-b0d2-4a737d9db962 req-0e92414a-666c-4d2d-a18a-663d2737ab01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b258660f-e099-4e37-ab2a-4049ad88a647", "name": "network-vif-unplugged", "status": "completed", "tag": "70dd01d5-20d6-47f1-8ddc-7d15de6b2627"}]} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:47:42.018734 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-99a1da6d-9917-41d7-b0d2-4a737d9db962 req-0e92414a-666c-4d2d-a18a-663d2737ab01 service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:42.021880 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-99a1da6d-9917-41d7-b0d2-4a737d9db962 req-0e92414a-666c-4d2d-a18a-663d2737ab01 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:42.022472 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-99a1da6d-9917-41d7-b0d2-4a737d9db962 req-0e92414a-666c-4d2d-a18a-663d2737ab01 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:42.052207 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.compute.server_external_events [req-99a1da6d-9917-41d7-b0d2-4a737d9db962 req-0e92414a-666c-4d2d-a18a-663d2737ab01 service nova] Creating event network-vif-unplugged:70dd01d5-20d6-47f1-8ddc-7d15de6b2627 for instance b258660f-e099-4e37-ab2a-4049ad88a647 on hv-cinder-85427 Aug 24 07:47:42.065822 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [req-99a1da6d-9917-41d7-b0d2-4a737d9db962 req-0e92414a-666c-4d2d-a18a-663d2737ab01 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082666 Aug 24 07:47:42.066902 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 424/857] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:47:42.799877 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-61161bbc-9eb8-4dcf-b409-32e1f5207f22 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:42.800511 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-61161bbc-9eb8-4dcf-b409-32e1f5207f22 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:42.813255 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-61161bbc-9eb8-4dcf-b409-32e1f5207f22 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:42.813769 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-61161bbc-9eb8-4dcf-b409-32e1f5207f22 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:42.814445 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-61161bbc-9eb8-4dcf-b409-32e1f5207f22 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:42.815178 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-61161bbc-9eb8-4dcf-b409-32e1f5207f22 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:42.815629 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-61161bbc-9eb8-4dcf-b409-32e1f5207f22 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:42.816050 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-61161bbc-9eb8-4dcf-b409-32e1f5207f22 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:42.975720 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-61161bbc-9eb8-4dcf-b409-32e1f5207f22 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:42.984374 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-61161bbc-9eb8-4dcf-b409-32e1f5207f22 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1573 microversion: 2.1 time: 0.188732 Aug 24 07:47:42.984940 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 434/858] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:47:42 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1573 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:47:43.681822 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-d772825d-029d-4090-99bf-ed4ee24a76ba tempest-VolumesNegativeTest-290933996 tempest-VolumesNegativeTest-290933996-project] Action: 'create', calling method: .version_select at 0x7faf5bc84d30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1733683850", "metadata": {"Type": "work"}}} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:47:43.692361 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-d772825d-029d-4090-99bf-ed4ee24a76ba tempest-VolumesNegativeTest-290933996 tempest-VolumesNegativeTest-290933996-project] Request method failure captured: Aug 24 07:47:43.692361 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 07:47:43.692361 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept: application/json Aug 24 07:47:43.692361 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept-Encoding: identity Aug 24 07:47:43.692361 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Connection: close Aug 24 07:47:43.692361 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Length: 122 Aug 24 07:47:43.692361 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Type: application/json Aug 24 07:47:43.692361 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Host: 10.222.0.42 Aug 24 07:47:43.692361 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Openstack-System-Scope: None Aug 24 07:47:43.692361 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: User-Agent: python-urllib3/1.26.11 Aug 24 07:47:43.692361 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Auth-Token: gAAAAABjBdefz_B0Yuf-No-muNTZ5ItBEUEfIH9Ehhf_KUVSEXBTD41mUzfaXrqRVvceHY5f4F_CkXw3mnjmF8UDjh1iljPTZwRfP_sYWGnjuJWbs96MsoVlqDvuMLa8PpVUnaBfBrHuhthIJ-_dKfsNTlWEgQp0TkW2hUscaMS8llvyNns-HBk Aug 24 07:47:43.692361 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Id: None Aug 24 07:47:43.692361 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Name: None Aug 24 07:47:43.692361 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Identity-Status: Confirmed Aug 24 07:47:43.692361 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Is-Admin-Project: True Aug 24 07:47:43.692361 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Id: default Aug 24 07:47:43.692361 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Name: Default Aug 24 07:47:43.692361 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Id: dba03b7ca9994946834ac2b70aaeda5d Aug 24 07:47:43.692361 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Name: tempest-VolumesNegativeTest-290933996 Aug 24 07:47:43.692361 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Role: reader,member Aug 24 07:47:43.692361 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Roles: reader,member Aug 24 07:47:43.693980 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dba03b7ca9994946834ac2b70aaeda5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dba03b7ca9994946834ac2b70aaeda5d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dba03b7ca9994946834ac2b70aaeda5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dba03b7ca9994946834ac2b70aaeda5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:47:43.693980 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant: tempest-VolumesNegativeTest-290933996 Aug 24 07:47:43.693980 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Id: dba03b7ca9994946834ac2b70aaeda5d Aug 24 07:47:43.693980 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Name: tempest-VolumesNegativeTest-290933996 Aug 24 07:47:43.693980 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User: tempest-VolumesNegativeTest-290933996-project Aug 24 07:47:43.693980 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Id: default Aug 24 07:47:43.693980 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Name: Default Aug 24 07:47:43.693980 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Id: 23418237eb98437eacfaee9ddf054c03 Aug 24 07:47:43.693980 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Name: tempest-VolumesNegativeTest-290933996-project Aug 24 07:47:43.693980 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Aug 24 07:47:43.693980 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1733683850", "metadata": {"Type": "work"}}} Aug 24 07:47:43.693980 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: method: Aug 24 07:47:43.693980 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 07:47:43.694988 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1733683850', 'metadata': {'Type': 'work'}}}} Aug 24 07:47:43.694988 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:47:43.694988 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:47:43.694988 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 07:47:43.694988 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 07:47:43.694988 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 07:47:43.694988 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise error Aug 24 07:47:43.694988 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 24 07:47:43.694988 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:47:43.694988 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 07:47:43.694988 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 07:47:43.694988 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:47:43.694988 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 07:47:43.694988 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi '#$%' Aug 24 07:47:43.694988 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:47:43.694988 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:47:43.694988 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:47:43.694988 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:47:43.694988 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:47:43.694988 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:47:43.694988 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:47:43.694988 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:47:43.696574 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 07:47:43.696574 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 07:47:43.696574 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:47:43.696574 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:47:43.696574 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 07:47:43.696574 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 07:47:43.696574 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 07:47:43.696574 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 07:47:43.696574 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 07:47:43.696574 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 07:47:43.696574 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 07:47:43.696574 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:47:43.696574 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:47:43.696574 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:47:43.696574 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:47:43.696574 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:47:43.696574 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:47:43.696574 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 07:47:43.696574 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 07:47:43.697815 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 07:47:43.697815 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:47:43.697815 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-d772825d-029d-4090-99bf-ed4ee24a76ba tempest-VolumesNegativeTest-290933996 tempest-VolumesNegativeTest-290933996-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:47:43.697815 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-d772825d-029d-4090-99bf-ed4ee24a76ba tempest-VolumesNegativeTest-290933996 tempest-VolumesNegativeTest-290933996-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.132263 Aug 24 07:47:43.697815 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 425/859] 10.222.0.42 () {60 vars in 1156 bytes} [Wed Aug 24 07:47:43 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 133 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 07:47:43.703301 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-3da6c567-1643-45ab-b876-6899bb4bb74e tempest-VolumesNegativeTest-290933996 tempest-VolumesNegativeTest-290933996-project] Action: 'create', calling method: .version_select at 0x7faf684331f0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-606492617", "metadata": {"Type": "work"}}} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:47:43.707820 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-3da6c567-1643-45ab-b876-6899bb4bb74e tempest-VolumesNegativeTest-290933996 tempest-VolumesNegativeTest-290933996-project] Request method failure captured: Aug 24 07:47:43.707820 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 07:47:43.707820 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept: application/json Aug 24 07:47:43.707820 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept-Encoding: identity Aug 24 07:47:43.707820 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Connection: close Aug 24 07:47:43.707820 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Length: 119 Aug 24 07:47:43.707820 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Type: application/json Aug 24 07:47:43.707820 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Host: 10.222.0.42 Aug 24 07:47:43.707820 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Openstack-System-Scope: None Aug 24 07:47:43.707820 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: User-Agent: python-urllib3/1.26.11 Aug 24 07:47:43.707820 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Auth-Token: gAAAAABjBdefz_B0Yuf-No-muNTZ5ItBEUEfIH9Ehhf_KUVSEXBTD41mUzfaXrqRVvceHY5f4F_CkXw3mnjmF8UDjh1iljPTZwRfP_sYWGnjuJWbs96MsoVlqDvuMLa8PpVUnaBfBrHuhthIJ-_dKfsNTlWEgQp0TkW2hUscaMS8llvyNns-HBk Aug 24 07:47:43.707820 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Id: None Aug 24 07:47:43.707820 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Name: None Aug 24 07:47:43.707820 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Identity-Status: Confirmed Aug 24 07:47:43.707820 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Is-Admin-Project: True Aug 24 07:47:43.707820 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Id: default Aug 24 07:47:43.707820 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Name: Default Aug 24 07:47:43.707820 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Id: dba03b7ca9994946834ac2b70aaeda5d Aug 24 07:47:43.707820 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Name: tempest-VolumesNegativeTest-290933996 Aug 24 07:47:43.707820 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Role: reader,member Aug 24 07:47:43.707820 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Roles: reader,member Aug 24 07:47:43.709331 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dba03b7ca9994946834ac2b70aaeda5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dba03b7ca9994946834ac2b70aaeda5d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dba03b7ca9994946834ac2b70aaeda5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dba03b7ca9994946834ac2b70aaeda5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:47:43.709331 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant: tempest-VolumesNegativeTest-290933996 Aug 24 07:47:43.709331 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Id: dba03b7ca9994946834ac2b70aaeda5d Aug 24 07:47:43.709331 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Name: tempest-VolumesNegativeTest-290933996 Aug 24 07:47:43.709331 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User: tempest-VolumesNegativeTest-290933996-project Aug 24 07:47:43.709331 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Id: default Aug 24 07:47:43.709331 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Name: Default Aug 24 07:47:43.709331 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Id: 23418237eb98437eacfaee9ddf054c03 Aug 24 07:47:43.709331 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Name: tempest-VolumesNegativeTest-290933996-project Aug 24 07:47:43.709331 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Aug 24 07:47:43.709331 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-606492617", "metadata": {"Type": "work"}}} Aug 24 07:47:43.709331 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: method: Aug 24 07:47:43.709331 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 07:47:43.710253 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-606492617', 'metadata': {'Type': 'work'}}}} Aug 24 07:47:43.710253 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:47:43.710253 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:47:43.710253 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 07:47:43.710253 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 07:47:43.710253 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 07:47:43.710253 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise error Aug 24 07:47:43.710253 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 24 07:47:43.710253 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:47:43.710253 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 24 07:47:43.710253 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 07:47:43.710253 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:47:43.710253 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 07:47:43.710253 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi '0' Aug 24 07:47:43.710253 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:47:43.710253 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:47:43.710253 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:47:43.710253 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:47:43.710253 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:47:43.710253 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:47:43.710253 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:47:43.710253 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:47:43.711904 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 07:47:43.711904 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 07:47:43.711904 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:47:43.711904 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:47:43.711904 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 07:47:43.711904 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 07:47:43.711904 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 07:47:43.711904 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 07:47:43.711904 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 07:47:43.711904 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 07:47:43.711904 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 07:47:43.711904 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:47:43.711904 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:47:43.711904 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:47:43.711904 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:47:43.711904 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:47:43.711904 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:47:43.711904 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 07:47:43.711904 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 07:47:43.713096 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 07:47:43.713096 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:47:43.713096 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-3da6c567-1643-45ab-b876-6899bb4bb74e tempest-VolumesNegativeTest-290933996 tempest-VolumesNegativeTest-290933996-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:47:43.713096 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-3da6c567-1643-45ab-b876-6899bb4bb74e tempest-VolumesNegativeTest-290933996 tempest-VolumesNegativeTest-290933996-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009686 Aug 24 07:47:43.713096 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 435/860] 10.222.0.42 () {60 vars in 1156 bytes} [Wed Aug 24 07:47:43 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 07:47:43.717824 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-6c1f7252-41a5-4a50-b539-d0de063c986d tempest-VolumesNegativeTest-290933996 tempest-VolumesNegativeTest-290933996-project] Action: 'create', calling method: .version_select at 0x7faf5bc3ee50>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-943637926", "metadata": {"Type": "work"}}} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:47:43.722952 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-6c1f7252-41a5-4a50-b539-d0de063c986d tempest-VolumesNegativeTest-290933996 tempest-VolumesNegativeTest-290933996-project] Request method failure captured: Aug 24 07:47:43.722952 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 07:47:43.722952 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept: application/json Aug 24 07:47:43.722952 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept-Encoding: identity Aug 24 07:47:43.722952 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Connection: close Aug 24 07:47:43.722952 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Length: 118 Aug 24 07:47:43.722952 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Type: application/json Aug 24 07:47:43.722952 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Host: 10.222.0.42 Aug 24 07:47:43.722952 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Openstack-System-Scope: None Aug 24 07:47:43.722952 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: User-Agent: python-urllib3/1.26.11 Aug 24 07:47:43.722952 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Auth-Token: gAAAAABjBdefz_B0Yuf-No-muNTZ5ItBEUEfIH9Ehhf_KUVSEXBTD41mUzfaXrqRVvceHY5f4F_CkXw3mnjmF8UDjh1iljPTZwRfP_sYWGnjuJWbs96MsoVlqDvuMLa8PpVUnaBfBrHuhthIJ-_dKfsNTlWEgQp0TkW2hUscaMS8llvyNns-HBk Aug 24 07:47:43.722952 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Id: None Aug 24 07:47:43.722952 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Name: None Aug 24 07:47:43.722952 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Identity-Status: Confirmed Aug 24 07:47:43.722952 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Is-Admin-Project: True Aug 24 07:47:43.722952 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Id: default Aug 24 07:47:43.722952 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Name: Default Aug 24 07:47:43.722952 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Id: dba03b7ca9994946834ac2b70aaeda5d Aug 24 07:47:43.722952 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Name: tempest-VolumesNegativeTest-290933996 Aug 24 07:47:43.722952 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Role: reader,member Aug 24 07:47:43.722952 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Roles: reader,member Aug 24 07:47:43.724436 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dba03b7ca9994946834ac2b70aaeda5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dba03b7ca9994946834ac2b70aaeda5d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dba03b7ca9994946834ac2b70aaeda5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dba03b7ca9994946834ac2b70aaeda5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:47:43.724436 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant: tempest-VolumesNegativeTest-290933996 Aug 24 07:47:43.724436 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Id: dba03b7ca9994946834ac2b70aaeda5d Aug 24 07:47:43.724436 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Name: tempest-VolumesNegativeTest-290933996 Aug 24 07:47:43.724436 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User: tempest-VolumesNegativeTest-290933996-project Aug 24 07:47:43.724436 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Id: default Aug 24 07:47:43.724436 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Name: Default Aug 24 07:47:43.724436 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Id: 23418237eb98437eacfaee9ddf054c03 Aug 24 07:47:43.724436 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Name: tempest-VolumesNegativeTest-290933996-project Aug 24 07:47:43.724436 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Aug 24 07:47:43.724436 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-943637926", "metadata": {"Type": "work"}}} Aug 24 07:47:43.724436 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: method: Aug 24 07:47:43.724436 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 07:47:43.725367 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-943637926', 'metadata': {'Type': 'work'}}}} Aug 24 07:47:43.725367 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:47:43.725367 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:47:43.725367 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 07:47:43.725367 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 07:47:43.725367 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 07:47:43.725367 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise error Aug 24 07:47:43.725367 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 24 07:47:43.725367 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:47:43.725367 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 07:47:43.725367 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 07:47:43.725367 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:47:43.725367 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 07:47:43.725367 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi '' Aug 24 07:47:43.725367 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:47:43.725367 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:47:43.725367 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:47:43.725367 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:47:43.725367 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:47:43.725367 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:47:43.725367 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:47:43.725367 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:47:43.726969 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 07:47:43.726969 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 07:47:43.726969 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:47:43.726969 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:47:43.726969 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 07:47:43.726969 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 07:47:43.726969 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 07:47:43.726969 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 07:47:43.726969 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 07:47:43.726969 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 07:47:43.726969 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 07:47:43.726969 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:47:43.726969 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:47:43.726969 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:47:43.726969 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:47:43.726969 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:47:43.726969 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:47:43.726969 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 07:47:43.726969 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 07:47:43.728241 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 07:47:43.728241 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:47:43.728241 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-6c1f7252-41a5-4a50-b539-d0de063c986d tempest-VolumesNegativeTest-290933996 tempest-VolumesNegativeTest-290933996-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:47:43.728241 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-6c1f7252-41a5-4a50-b539-d0de063c986d tempest-VolumesNegativeTest-290933996 tempest-VolumesNegativeTest-290933996-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010064 Aug 24 07:47:43.728241 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 426/861] 10.222.0.42 () {60 vars in 1156 bytes} [Wed Aug 24 07:47:43 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 07:47:43.735459 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-db995a88-2fda-4a42-ab2c-0e551c529322 tempest-VolumesNegativeTest-290933996 tempest-VolumesNegativeTest-290933996-project] Calling method '.version_select at 0x7faf684ca790>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:43.763286 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.wsgi [None req-db995a88-2fda-4a42-ab2c-0e551c529322 tempest-VolumesNegativeTest-290933996 tempest-VolumesNegativeTest-290933996-project] HTTP exception thrown: Volume tempest-invalid-1695999185 could not be found. Aug 24 07:47:43.766581 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-db995a88-2fda-4a42-ab2c-0e551c529322 tempest-VolumesNegativeTest-290933996 tempest-VolumesNegativeTest-290933996-project] Request method failure captured: Aug 24 07:47:43.766581 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1695999185 HTTP/1.1 Aug 24 07:47:43.766581 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept: application/json Aug 24 07:47:43.766581 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept-Encoding: identity Aug 24 07:47:43.766581 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Connection: close Aug 24 07:47:43.766581 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Length: 0 Aug 24 07:47:43.766581 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Type: application/json Aug 24 07:47:43.766581 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Host: 10.222.0.42 Aug 24 07:47:43.766581 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Openstack-System-Scope: None Aug 24 07:47:43.766581 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: User-Agent: python-urllib3/1.26.11 Aug 24 07:47:43.766581 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Auth-Token: gAAAAABjBdefz_B0Yuf-No-muNTZ5ItBEUEfIH9Ehhf_KUVSEXBTD41mUzfaXrqRVvceHY5f4F_CkXw3mnjmF8UDjh1iljPTZwRfP_sYWGnjuJWbs96MsoVlqDvuMLa8PpVUnaBfBrHuhthIJ-_dKfsNTlWEgQp0TkW2hUscaMS8llvyNns-HBk Aug 24 07:47:43.766581 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Id: None Aug 24 07:47:43.766581 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Name: None Aug 24 07:47:43.766581 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Identity-Status: Confirmed Aug 24 07:47:43.766581 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Is-Admin-Project: True Aug 24 07:47:43.766581 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Id: default Aug 24 07:47:43.766581 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Name: Default Aug 24 07:47:43.766581 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Id: dba03b7ca9994946834ac2b70aaeda5d Aug 24 07:47:43.766581 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Name: tempest-VolumesNegativeTest-290933996 Aug 24 07:47:43.766581 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Role: reader,member Aug 24 07:47:43.766581 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Roles: reader,member Aug 24 07:47:43.768115 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dba03b7ca9994946834ac2b70aaeda5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dba03b7ca9994946834ac2b70aaeda5d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dba03b7ca9994946834ac2b70aaeda5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dba03b7ca9994946834ac2b70aaeda5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:47:43.768115 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant: tempest-VolumesNegativeTest-290933996 Aug 24 07:47:43.768115 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Id: dba03b7ca9994946834ac2b70aaeda5d Aug 24 07:47:43.768115 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Name: tempest-VolumesNegativeTest-290933996 Aug 24 07:47:43.768115 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User: tempest-VolumesNegativeTest-290933996-project Aug 24 07:47:43.768115 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Id: default Aug 24 07:47:43.768115 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Name: Default Aug 24 07:47:43.768115 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Id: 23418237eb98437eacfaee9ddf054c03 Aug 24 07:47:43.768115 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Name: tempest-VolumesNegativeTest-290933996-project Aug 24 07:47:43.768115 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: method: Aug 24 07:47:43.768115 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: exception: Volume tempest-invalid-1695999185 could not be found. Aug 24 07:47:43.768115 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: action_args: {'id': 'tempest-invalid-1695999185'} Aug 24 07:47:43.768115 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:47:43.769161 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:47:43.769161 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 07:47:43.769161 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 07:47:43.769161 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 07:47:43.769161 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 07:47:43.769161 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 07:47:43.769161 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 07:47:43.769161 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 07:47:43.769161 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 07:47:43.769161 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 07:47:43.769161 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 07:47:43.769161 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 07:47:43.769161 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 07:47:43.769161 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 07:47:43.769161 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 07:47:43.769161 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1695999185 could not be found. (HTTP 404) (Request-ID: req-901f7d13-8e30-4045-805e-d7dda1011baf) Aug 24 07:47:43.769161 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:47:43.769161 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:47:43.769161 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:47:43.770420 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:47:43.770420 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 07:47:43.770420 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 07:47:43.770420 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 07:47:43.770420 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 07:47:43.770420 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 07:47:43.770420 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 07:47:43.770420 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 07:47:43.770420 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 07:47:43.770420 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 07:47:43.770420 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 07:47:43.770420 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 07:47:43.770420 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 07:47:43.770420 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 07:47:43.770420 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 07:47:43.770420 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 07:47:43.770420 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 07:47:43.770420 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 07:47:43.770420 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 07:47:43.771625 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 07:47:43.771625 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 07:47:43.771625 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 07:47:43.771625 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 07:47:43.771625 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1695999185 could not be found. Aug 24 07:47:43.771625 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:47:43.771625 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:47:43.771625 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:47:43.771625 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:47:43.771625 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:47:43.771625 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:47:43.771625 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:47:43.771625 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:47:43.771625 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 07:47:43.771625 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 07:47:43.771625 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:47:43.771625 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:47:43.771625 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 07:47:43.771625 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:47:43.771625 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1695999185 could not be found. Aug 24 07:47:43.773296 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:47:43.773296 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:47:43.773296 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:47:43.773296 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:47:43.773296 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:47:43.773296 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:47:43.773296 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:47:43.773296 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:47:43.773296 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1695999185 could not be found. Aug 24 07:47:43.773296 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:47:43.773296 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-db995a88-2fda-4a42-ab2c-0e551c529322 tempest-VolumesNegativeTest-290933996 tempest-VolumesNegativeTest-290933996-project] Returning 404 to user: Volume tempest-invalid-1695999185 could not be found. {{(pid=127114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:47:43.773296 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-db995a88-2fda-4a42-ab2c-0e551c529322 tempest-VolumesNegativeTest-290933996 tempest-VolumesNegativeTest-290933996-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1695999185" status: 404 len: 99 microversion: 2.1 time: 0.036772 Aug 24 07:47:43.773296 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 436/862] 10.222.0.42 () {58 vars in 1218 bytes} [Wed Aug 24 07:47:43 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1695999185 => generated 99 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 07:47:43.777887 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-24fafaf6-7382-458a-84d5-83c4f1010181 tempest-VolumesNegativeTest-290933996 tempest-VolumesNegativeTest-290933996-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003685 Aug 24 07:47:43.778368 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 427/863] 10.222.0.42 () {58 vars in 1140 bytes} [Wed Aug 24 07:47:43 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 07:47:43.786932 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-80a91526-de45-4512-bf01-bcac5062df8e tempest-VolumesNegativeTest-290933996 tempest-VolumesNegativeTest-290933996-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003586 Aug 24 07:47:43.787416 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 437/864] 10.222.0.42 () {58 vars in 1137 bytes} [Wed Aug 24 07:47:43 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 07:47:43.795148 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-bec3781a-8010-4fa2-8ac4-b2d15e084850 tempest-VolumesNegativeTest-290933996 tempest-VolumesNegativeTest-290933996-project] Calling method '.version_select at 0x7faf5bbf3af0>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:43.823607 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.wsgi [None req-bec3781a-8010-4fa2-8ac4-b2d15e084850 tempest-VolumesNegativeTest-290933996 tempest-VolumesNegativeTest-290933996-project] HTTP exception thrown: Volume 07e7534e-a43c-425a-a206-b655413e020d could not be found. Aug 24 07:47:43.827881 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-bec3781a-8010-4fa2-8ac4-b2d15e084850 tempest-VolumesNegativeTest-290933996 tempest-VolumesNegativeTest-290933996-project] Request method failure captured: Aug 24 07:47:43.827881 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: request: DELETE /compute/v2.1/os-volumes/07e7534e-a43c-425a-a206-b655413e020d HTTP/1.1 Aug 24 07:47:43.827881 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept: application/json Aug 24 07:47:43.827881 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept-Encoding: identity Aug 24 07:47:43.827881 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Connection: close Aug 24 07:47:43.827881 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Length: 0 Aug 24 07:47:43.827881 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Type: application/json Aug 24 07:47:43.827881 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Host: 10.222.0.42 Aug 24 07:47:43.827881 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Openstack-System-Scope: None Aug 24 07:47:43.827881 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: User-Agent: python-urllib3/1.26.11 Aug 24 07:47:43.827881 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Auth-Token: gAAAAABjBdefz_B0Yuf-No-muNTZ5ItBEUEfIH9Ehhf_KUVSEXBTD41mUzfaXrqRVvceHY5f4F_CkXw3mnjmF8UDjh1iljPTZwRfP_sYWGnjuJWbs96MsoVlqDvuMLa8PpVUnaBfBrHuhthIJ-_dKfsNTlWEgQp0TkW2hUscaMS8llvyNns-HBk Aug 24 07:47:43.827881 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Id: None Aug 24 07:47:43.827881 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Name: None Aug 24 07:47:43.827881 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Identity-Status: Confirmed Aug 24 07:47:43.827881 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Is-Admin-Project: True Aug 24 07:47:43.827881 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Id: default Aug 24 07:47:43.827881 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Name: Default Aug 24 07:47:43.827881 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Id: dba03b7ca9994946834ac2b70aaeda5d Aug 24 07:47:43.827881 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Name: tempest-VolumesNegativeTest-290933996 Aug 24 07:47:43.827881 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Role: reader,member Aug 24 07:47:43.827881 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Roles: reader,member Aug 24 07:47:43.829441 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dba03b7ca9994946834ac2b70aaeda5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dba03b7ca9994946834ac2b70aaeda5d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dba03b7ca9994946834ac2b70aaeda5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dba03b7ca9994946834ac2b70aaeda5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:47:43.829441 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant: tempest-VolumesNegativeTest-290933996 Aug 24 07:47:43.829441 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Id: dba03b7ca9994946834ac2b70aaeda5d Aug 24 07:47:43.829441 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Name: tempest-VolumesNegativeTest-290933996 Aug 24 07:47:43.829441 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User: tempest-VolumesNegativeTest-290933996-project Aug 24 07:47:43.829441 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Id: default Aug 24 07:47:43.829441 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Name: Default Aug 24 07:47:43.829441 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Id: 23418237eb98437eacfaee9ddf054c03 Aug 24 07:47:43.829441 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Name: tempest-VolumesNegativeTest-290933996-project Aug 24 07:47:43.829441 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: method: Aug 24 07:47:43.829441 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: exception: Volume 07e7534e-a43c-425a-a206-b655413e020d could not be found. Aug 24 07:47:43.829441 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: action_args: {'id': '07e7534e-a43c-425a-a206-b655413e020d'} Aug 24 07:47:43.829441 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:47:43.830361 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:47:43.830361 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 07:47:43.830361 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 07:47:43.830361 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 07:47:43.830361 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 07:47:43.830361 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 07:47:43.830361 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 07:47:43.830361 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 07:47:43.830361 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 07:47:43.830361 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 07:47:43.830361 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 07:47:43.830361 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 07:47:43.830361 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 07:47:43.830361 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 07:47:43.830361 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 07:47:43.830361 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 07e7534e-a43c-425a-a206-b655413e020d could not be found. (HTTP 404) (Request-ID: req-14f11abb-1923-4b8a-9770-602ba23b2b1b) Aug 24 07:47:43.830361 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:47:43.830361 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:47:43.830361 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:47:43.831731 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:47:43.831731 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 07:47:43.831731 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 07:47:43.831731 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 07:47:43.831731 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 07:47:43.831731 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 07:47:43.831731 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 07:47:43.831731 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 07:47:43.831731 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 07:47:43.831731 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 07:47:43.831731 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 07:47:43.831731 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 07:47:43.831731 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 07:47:43.831731 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 07:47:43.831731 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 07:47:43.831731 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 07:47:43.831731 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 07:47:43.831731 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 07:47:43.831731 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 07:47:43.833082 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 07:47:43.833082 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 07:47:43.833082 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 07:47:43.833082 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 07:47:43.833082 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 07e7534e-a43c-425a-a206-b655413e020d could not be found. Aug 24 07:47:43.833082 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:47:43.833082 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:47:43.833082 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:47:43.833082 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:47:43.833082 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:47:43.833082 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:47:43.833082 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:47:43.833082 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:47:43.833082 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 07:47:43.833082 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 07:47:43.833082 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:47:43.833082 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:47:43.833082 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 07:47:43.833082 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:47:43.834424 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 07e7534e-a43c-425a-a206-b655413e020d could not be found. Aug 24 07:47:43.834424 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:47:43.834424 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:47:43.834424 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:47:43.834424 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:47:43.834424 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:47:43.834424 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:47:43.834424 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:47:43.834424 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:47:43.834424 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 07e7534e-a43c-425a-a206-b655413e020d could not be found. Aug 24 07:47:43.834424 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:47:43.834424 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-bec3781a-8010-4fa2-8ac4-b2d15e084850 tempest-VolumesNegativeTest-290933996 tempest-VolumesNegativeTest-290933996-project] Returning 404 to user: Volume 07e7534e-a43c-425a-a206-b655413e020d could not be found. {{(pid=127113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:47:43.834424 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-bec3781a-8010-4fa2-8ac4-b2d15e084850 tempest-VolumesNegativeTest-290933996 tempest-VolumesNegativeTest-290933996-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/07e7534e-a43c-425a-a206-b655413e020d" status: 404 len: 109 microversion: 2.1 time: 0.037524 Aug 24 07:47:43.834424 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 428/865] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Aug 24 07:47:43 2022] DELETE /compute/v2.1/os-volumes/07e7534e-a43c-425a-a206-b655413e020d => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:47:43.839487 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-0c460af3-b822-44dc-8265-7514d14994ed tempest-VolumesNegativeTest-290933996 tempest-VolumesNegativeTest-290933996-project] Calling method '.version_select at 0x7faf68433040>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:43.867149 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.wsgi [None req-0c460af3-b822-44dc-8265-7514d14994ed tempest-VolumesNegativeTest-290933996 tempest-VolumesNegativeTest-290933996-project] HTTP exception thrown: Volume fbcb8f28-08fc-4481-9617-5301c9d05dc1 could not be found. Aug 24 07:47:43.869110 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-0c460af3-b822-44dc-8265-7514d14994ed tempest-VolumesNegativeTest-290933996 tempest-VolumesNegativeTest-290933996-project] Request method failure captured: Aug 24 07:47:43.869110 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: request: GET /compute/v2.1/os-volumes/fbcb8f28-08fc-4481-9617-5301c9d05dc1 HTTP/1.1 Aug 24 07:47:43.869110 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept: application/json Aug 24 07:47:43.869110 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept-Encoding: identity Aug 24 07:47:43.869110 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Connection: close Aug 24 07:47:43.869110 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Length: 0 Aug 24 07:47:43.869110 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Type: application/json Aug 24 07:47:43.869110 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Host: 10.222.0.42 Aug 24 07:47:43.869110 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Openstack-System-Scope: None Aug 24 07:47:43.869110 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: User-Agent: python-urllib3/1.26.11 Aug 24 07:47:43.869110 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Auth-Token: gAAAAABjBdefz_B0Yuf-No-muNTZ5ItBEUEfIH9Ehhf_KUVSEXBTD41mUzfaXrqRVvceHY5f4F_CkXw3mnjmF8UDjh1iljPTZwRfP_sYWGnjuJWbs96MsoVlqDvuMLa8PpVUnaBfBrHuhthIJ-_dKfsNTlWEgQp0TkW2hUscaMS8llvyNns-HBk Aug 24 07:47:43.869110 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Id: None Aug 24 07:47:43.869110 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Name: None Aug 24 07:47:43.869110 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Identity-Status: Confirmed Aug 24 07:47:43.869110 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Is-Admin-Project: True Aug 24 07:47:43.869110 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Id: default Aug 24 07:47:43.869110 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Name: Default Aug 24 07:47:43.869110 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Id: dba03b7ca9994946834ac2b70aaeda5d Aug 24 07:47:43.869110 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Name: tempest-VolumesNegativeTest-290933996 Aug 24 07:47:43.869110 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Role: reader,member Aug 24 07:47:43.869110 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Roles: reader,member Aug 24 07:47:43.870614 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dba03b7ca9994946834ac2b70aaeda5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dba03b7ca9994946834ac2b70aaeda5d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dba03b7ca9994946834ac2b70aaeda5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dba03b7ca9994946834ac2b70aaeda5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:47:43.870614 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant: tempest-VolumesNegativeTest-290933996 Aug 24 07:47:43.870614 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Id: dba03b7ca9994946834ac2b70aaeda5d Aug 24 07:47:43.870614 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Name: tempest-VolumesNegativeTest-290933996 Aug 24 07:47:43.870614 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User: tempest-VolumesNegativeTest-290933996-project Aug 24 07:47:43.870614 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Id: default Aug 24 07:47:43.870614 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Name: Default Aug 24 07:47:43.870614 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Id: 23418237eb98437eacfaee9ddf054c03 Aug 24 07:47:43.870614 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Name: tempest-VolumesNegativeTest-290933996-project Aug 24 07:47:43.870614 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: method: Aug 24 07:47:43.870614 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: exception: Volume fbcb8f28-08fc-4481-9617-5301c9d05dc1 could not be found. Aug 24 07:47:43.870614 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: action_args: {'id': 'fbcb8f28-08fc-4481-9617-5301c9d05dc1'} Aug 24 07:47:43.870614 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:47:43.871620 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:47:43.871620 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 07:47:43.871620 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 07:47:43.871620 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 07:47:43.871620 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 07:47:43.871620 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 07:47:43.871620 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 07:47:43.871620 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 07:47:43.871620 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 07:47:43.871620 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 07:47:43.871620 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 07:47:43.871620 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 07:47:43.871620 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 07:47:43.871620 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 07:47:43.871620 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 07:47:43.871620 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fbcb8f28-08fc-4481-9617-5301c9d05dc1 could not be found. (HTTP 404) (Request-ID: req-b03ef3b4-da6b-4fa6-b24c-0808e9846a43) Aug 24 07:47:43.871620 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:47:43.871620 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:47:43.871620 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:47:43.873004 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:47:43.873004 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 07:47:43.873004 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 07:47:43.873004 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 07:47:43.873004 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 07:47:43.873004 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 07:47:43.873004 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 07:47:43.873004 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 07:47:43.873004 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 07:47:43.873004 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 07:47:43.873004 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 07:47:43.873004 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 07:47:43.873004 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 07:47:43.873004 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 07:47:43.873004 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 07:47:43.873004 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 07:47:43.873004 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 07:47:43.873004 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 07:47:43.873004 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 07:47:43.874330 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 07:47:43.874330 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 07:47:43.874330 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 07:47:43.874330 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 07:47:43.874330 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fbcb8f28-08fc-4481-9617-5301c9d05dc1 could not be found. Aug 24 07:47:43.874330 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:47:43.874330 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:47:43.874330 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:47:43.874330 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:47:43.874330 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:47:43.874330 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:47:43.874330 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:47:43.874330 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:47:43.874330 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 07:47:43.874330 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 07:47:43.874330 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:47:43.874330 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:47:43.874330 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 07:47:43.874330 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:47:43.875783 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fbcb8f28-08fc-4481-9617-5301c9d05dc1 could not be found. Aug 24 07:47:43.875783 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:47:43.875783 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:47:43.875783 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:47:43.875783 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:47:43.875783 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:47:43.875783 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:47:43.875783 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:47:43.875783 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:47:43.875783 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fbcb8f28-08fc-4481-9617-5301c9d05dc1 could not be found. Aug 24 07:47:43.875783 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:47:43.875783 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-0c460af3-b822-44dc-8265-7514d14994ed tempest-VolumesNegativeTest-290933996 tempest-VolumesNegativeTest-290933996-project] Returning 404 to user: Volume fbcb8f28-08fc-4481-9617-5301c9d05dc1 could not be found. {{(pid=127114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:47:43.875783 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-0c460af3-b822-44dc-8265-7514d14994ed tempest-VolumesNegativeTest-290933996 tempest-VolumesNegativeTest-290933996-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/fbcb8f28-08fc-4481-9617-5301c9d05dc1" status: 404 len: 109 microversion: 2.1 time: 0.035342 Aug 24 07:47:43.875783 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 438/866] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Aug 24 07:47:43 2022] GET /compute/v2.1/os-volumes/fbcb8f28-08fc-4481-9617-5301c9d05dc1 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:47:44.005862 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-fd9b5b5b-7221-4065-b212-abe420802209 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:44.006591 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-fd9b5b5b-7221-4065-b212-abe420802209 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:44.012849 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-fd9b5b5b-7221-4065-b212-abe420802209 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:44.013331 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-fd9b5b5b-7221-4065-b212-abe420802209 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:44.013762 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-fd9b5b5b-7221-4065-b212-abe420802209 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:44.014446 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-fd9b5b5b-7221-4065-b212-abe420802209 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:44.014928 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-fd9b5b5b-7221-4065-b212-abe420802209 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:44.015992 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-fd9b5b5b-7221-4065-b212-abe420802209 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:44.157000 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-fd9b5b5b-7221-4065-b212-abe420802209 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:44.165070 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-fd9b5b5b-7221-4065-b212-abe420802209 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1573 microversion: 2.1 time: 0.163432 Aug 24 07:47:44.165631 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 429/867] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:47:44 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1573 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:47:45.186283 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-58bf8ace-d936-4c45-b11a-4776f7fca9ba tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:45.186913 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-58bf8ace-d936-4c45-b11a-4776f7fca9ba tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:45.192819 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-58bf8ace-d936-4c45-b11a-4776f7fca9ba tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:45.193294 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-58bf8ace-d936-4c45-b11a-4776f7fca9ba tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:45.193722 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-58bf8ace-d936-4c45-b11a-4776f7fca9ba tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:45.194405 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-58bf8ace-d936-4c45-b11a-4776f7fca9ba tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:45.194911 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-58bf8ace-d936-4c45-b11a-4776f7fca9ba tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:45.195361 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-58bf8ace-d936-4c45-b11a-4776f7fca9ba tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:45.332500 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-58bf8ace-d936-4c45-b11a-4776f7fca9ba tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:45.340321 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-58bf8ace-d936-4c45-b11a-4776f7fca9ba tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1573 microversion: 2.1 time: 0.158837 Aug 24 07:47:45.340882 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 439/868] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:47:45 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:47:46.368447 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-22037265-f358-49bc-90d6-393c37b6dead tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:46.369089 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-22037265-f358-49bc-90d6-393c37b6dead tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:46.376839 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-22037265-f358-49bc-90d6-393c37b6dead tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:46.378221 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-22037265-f358-49bc-90d6-393c37b6dead tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:46.378991 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-22037265-f358-49bc-90d6-393c37b6dead tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:46.380158 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-22037265-f358-49bc-90d6-393c37b6dead tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:46.380963 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-22037265-f358-49bc-90d6-393c37b6dead tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:46.381578 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-22037265-f358-49bc-90d6-393c37b6dead tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:46.555753 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-22037265-f358-49bc-90d6-393c37b6dead tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:46.564462 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-22037265-f358-49bc-90d6-393c37b6dead tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1573 microversion: 2.1 time: 0.201580 Aug 24 07:47:46.565054 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 430/869] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:47:46 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1573 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:47:47.589445 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-a6e97049-0b72-430c-97da-34e27ab3936b tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:47.592173 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-a6e97049-0b72-430c-97da-34e27ab3936b tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:47.598733 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a6e97049-0b72-430c-97da-34e27ab3936b tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:47.599465 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a6e97049-0b72-430c-97da-34e27ab3936b tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:47.599958 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a6e97049-0b72-430c-97da-34e27ab3936b tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:47.600672 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a6e97049-0b72-430c-97da-34e27ab3936b tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:47.601128 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a6e97049-0b72-430c-97da-34e27ab3936b tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:47.601555 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a6e97049-0b72-430c-97da-34e27ab3936b tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:47.748651 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-a6e97049-0b72-430c-97da-34e27ab3936b tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:47.760747 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-a6e97049-0b72-430c-97da-34e27ab3936b tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1573 microversion: 2.1 time: 0.178085 Aug 24 07:47:47.761346 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 440/870] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:47:47 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1573 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:47:48.781196 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-3c909eb7-0f3c-4951-8650-f1c3ec44efc0 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:48.781738 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-3c909eb7-0f3c-4951-8650-f1c3ec44efc0 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:48.788953 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3c909eb7-0f3c-4951-8650-f1c3ec44efc0 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:48.789522 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3c909eb7-0f3c-4951-8650-f1c3ec44efc0 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:48.790072 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3c909eb7-0f3c-4951-8650-f1c3ec44efc0 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:48.791139 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3c909eb7-0f3c-4951-8650-f1c3ec44efc0 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:48.791783 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3c909eb7-0f3c-4951-8650-f1c3ec44efc0 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:48.792429 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3c909eb7-0f3c-4951-8650-f1c3ec44efc0 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:48.932694 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-3c909eb7-0f3c-4951-8650-f1c3ec44efc0 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:48.941781 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-3c909eb7-0f3c-4951-8650-f1c3ec44efc0 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1573 microversion: 2.1 time: 0.164609 Aug 24 07:47:48.942820 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 431/871] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:47:48 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1573 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:47:49.964297 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-7008dc01-619b-4407-af09-b9c79df44c91 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:49.964877 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-7008dc01-619b-4407-af09-b9c79df44c91 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:49.972990 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7008dc01-619b-4407-af09-b9c79df44c91 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:49.973475 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7008dc01-619b-4407-af09-b9c79df44c91 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:49.974233 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7008dc01-619b-4407-af09-b9c79df44c91 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:49.974960 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7008dc01-619b-4407-af09-b9c79df44c91 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:49.975404 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7008dc01-619b-4407-af09-b9c79df44c91 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:49.975986 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7008dc01-619b-4407-af09-b9c79df44c91 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:50.125702 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-7008dc01-619b-4407-af09-b9c79df44c91 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:50.133862 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-7008dc01-619b-4407-af09-b9c79df44c91 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1573 microversion: 2.1 time: 0.173913 Aug 24 07:47:50.134423 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 441/872] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:47:49 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1573 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:47:51.155183 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-531e9985-0c02-4298-a212-b108475e8156 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:51.155797 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-531e9985-0c02-4298-a212-b108475e8156 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:51.162984 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-531e9985-0c02-4298-a212-b108475e8156 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:51.163467 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-531e9985-0c02-4298-a212-b108475e8156 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:51.163897 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-531e9985-0c02-4298-a212-b108475e8156 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:51.164584 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-531e9985-0c02-4298-a212-b108475e8156 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:51.165081 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-531e9985-0c02-4298-a212-b108475e8156 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:51.165501 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-531e9985-0c02-4298-a212-b108475e8156 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:51.295857 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-531e9985-0c02-4298-a212-b108475e8156 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:51.304585 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-531e9985-0c02-4298-a212-b108475e8156 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1573 microversion: 2.1 time: 0.153210 Aug 24 07:47:51.305280 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 432/873] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:47:51 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:47:52.325156 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-0c98c690-aae5-4ebd-a5db-a1e02ff62379 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:52.325793 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-0c98c690-aae5-4ebd-a5db-a1e02ff62379 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:52.332298 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0c98c690-aae5-4ebd-a5db-a1e02ff62379 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:52.332776 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0c98c690-aae5-4ebd-a5db-a1e02ff62379 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:52.333211 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0c98c690-aae5-4ebd-a5db-a1e02ff62379 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:52.333897 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0c98c690-aae5-4ebd-a5db-a1e02ff62379 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:52.334345 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0c98c690-aae5-4ebd-a5db-a1e02ff62379 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:52.334788 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0c98c690-aae5-4ebd-a5db-a1e02ff62379 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:52.471447 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-0c98c690-aae5-4ebd-a5db-a1e02ff62379 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:52.479254 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-0c98c690-aae5-4ebd-a5db-a1e02ff62379 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1573 microversion: 2.1 time: 0.157855 Aug 24 07:47:52.479816 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 442/874] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:47:52 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:47:53.501349 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-f0c67a0a-46b9-47b0-91b9-36cb08812e24 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:53.501982 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-f0c67a0a-46b9-47b0-91b9-36cb08812e24 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:53.508488 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f0c67a0a-46b9-47b0-91b9-36cb08812e24 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:53.508957 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f0c67a0a-46b9-47b0-91b9-36cb08812e24 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:53.510116 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f0c67a0a-46b9-47b0-91b9-36cb08812e24 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:53.510851 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f0c67a0a-46b9-47b0-91b9-36cb08812e24 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:53.511307 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f0c67a0a-46b9-47b0-91b9-36cb08812e24 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:53.511731 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f0c67a0a-46b9-47b0-91b9-36cb08812e24 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:53.662439 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-f0c67a0a-46b9-47b0-91b9-36cb08812e24 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:53.670208 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-f0c67a0a-46b9-47b0-91b9-36cb08812e24 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1573 microversion: 2.1 time: 0.173836 Aug 24 07:47:53.670786 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 433/875] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:47:53 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1573 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:47:54.691868 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-a7abe7fd-25a9-4cfb-9903-0df53f5d587b tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:54.692503 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-a7abe7fd-25a9-4cfb-9903-0df53f5d587b tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:54.698938 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a7abe7fd-25a9-4cfb-9903-0df53f5d587b tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:54.699413 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a7abe7fd-25a9-4cfb-9903-0df53f5d587b tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:54.699845 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a7abe7fd-25a9-4cfb-9903-0df53f5d587b tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:54.700607 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a7abe7fd-25a9-4cfb-9903-0df53f5d587b tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:54.701063 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a7abe7fd-25a9-4cfb-9903-0df53f5d587b tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:54.701479 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a7abe7fd-25a9-4cfb-9903-0df53f5d587b tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:54.837296 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-a7abe7fd-25a9-4cfb-9903-0df53f5d587b tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:54.845855 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-a7abe7fd-25a9-4cfb-9903-0df53f5d587b tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1573 microversion: 2.1 time: 0.158643 Aug 24 07:47:54.846415 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 443/876] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:47:54 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:47:55.303238 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [req-ffa28c94-dfae-443f-a844-e1fa1c2b354c req-1b27454e-1163-4a0a-96de-2e13828804ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b258660f-e099-4e37-ab2a-4049ad88a647", "name": "network-vif-plugged", "status": "completed", "tag": "70dd01d5-20d6-47f1-8ddc-7d15de6b2627"}]} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:47:55.314878 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-ffa28c94-dfae-443f-a844-e1fa1c2b354c req-1b27454e-1163-4a0a-96de-2e13828804ea service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:55.315353 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-ffa28c94-dfae-443f-a844-e1fa1c2b354c req-1b27454e-1163-4a0a-96de-2e13828804ea service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:55.316255 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-ffa28c94-dfae-443f-a844-e1fa1c2b354c req-1b27454e-1163-4a0a-96de-2e13828804ea service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:55.327218 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.compute.server_external_events [req-ffa28c94-dfae-443f-a844-e1fa1c2b354c req-1b27454e-1163-4a0a-96de-2e13828804ea service nova] Creating event network-vif-plugged:70dd01d5-20d6-47f1-8ddc-7d15de6b2627 for instance b258660f-e099-4e37-ab2a-4049ad88a647 on hv-cinder-85427 Aug 24 07:47:55.333085 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [req-ffa28c94-dfae-443f-a844-e1fa1c2b354c req-1b27454e-1163-4a0a-96de-2e13828804ea service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033481 Aug 24 07:47:55.334130 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 434/877] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:47:55.867435 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-61944d18-4d33-444f-b899-7d9000959e8a tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:55.868061 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-61944d18-4d33-444f-b899-7d9000959e8a tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:55.874503 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-61944d18-4d33-444f-b899-7d9000959e8a tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:55.875662 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-61944d18-4d33-444f-b899-7d9000959e8a tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:55.876090 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-61944d18-4d33-444f-b899-7d9000959e8a tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:55.876764 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-61944d18-4d33-444f-b899-7d9000959e8a tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:55.877214 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-61944d18-4d33-444f-b899-7d9000959e8a tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:55.877645 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-61944d18-4d33-444f-b899-7d9000959e8a tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:56.275985 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-61944d18-4d33-444f-b899-7d9000959e8a tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:56.284705 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-61944d18-4d33-444f-b899-7d9000959e8a tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1573 microversion: 2.1 time: 0.420994 Aug 24 07:47:56.285558 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 444/878] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:47:55 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1573 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:47:57.309011 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-748b2b9d-d587-4f3b-999c-a9192e75be34 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:57.309695 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-748b2b9d-d587-4f3b-999c-a9192e75be34 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:57.316677 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-748b2b9d-d587-4f3b-999c-a9192e75be34 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:57.317151 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-748b2b9d-d587-4f3b-999c-a9192e75be34 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:57.317576 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-748b2b9d-d587-4f3b-999c-a9192e75be34 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:57.318245 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-748b2b9d-d587-4f3b-999c-a9192e75be34 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:57.318687 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-748b2b9d-d587-4f3b-999c-a9192e75be34 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:57.319121 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-748b2b9d-d587-4f3b-999c-a9192e75be34 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:57.453830 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-748b2b9d-d587-4f3b-999c-a9192e75be34 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:57.461732 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-748b2b9d-d587-4f3b-999c-a9192e75be34 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1573 microversion: 2.1 time: 0.156897 Aug 24 07:47:57.462293 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 435/879] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:47:57 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:47:58.482631 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-c2c86b2d-2f20-4507-ae46-46917913202e tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:58.483286 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-c2c86b2d-2f20-4507-ae46-46917913202e tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:58.489306 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c2c86b2d-2f20-4507-ae46-46917913202e tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:58.489787 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c2c86b2d-2f20-4507-ae46-46917913202e tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:58.490219 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c2c86b2d-2f20-4507-ae46-46917913202e tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:58.490927 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c2c86b2d-2f20-4507-ae46-46917913202e tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:58.491377 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c2c86b2d-2f20-4507-ae46-46917913202e tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:58.491791 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c2c86b2d-2f20-4507-ae46-46917913202e tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:58.618262 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-c2c86b2d-2f20-4507-ae46-46917913202e tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:58.626602 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-c2c86b2d-2f20-4507-ae46-46917913202e tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1573 microversion: 2.1 time: 0.147993 Aug 24 07:47:58.627192 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 445/880] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:47:58 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1573 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:47:59.649101 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-25c3fea5-bf25-4661-ae20-5adf7808a6f2 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:47:59.649710 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-25c3fea5-bf25-4661-ae20-5adf7808a6f2 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:47:59.656496 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-25c3fea5-bf25-4661-ae20-5adf7808a6f2 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:59.656972 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-25c3fea5-bf25-4661-ae20-5adf7808a6f2 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:59.657395 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-25c3fea5-bf25-4661-ae20-5adf7808a6f2 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:59.658078 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-25c3fea5-bf25-4661-ae20-5adf7808a6f2 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:47:59.658526 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-25c3fea5-bf25-4661-ae20-5adf7808a6f2 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:47:59.659003 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-25c3fea5-bf25-4661-ae20-5adf7808a6f2 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:47:59.791385 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-25c3fea5-bf25-4661-ae20-5adf7808a6f2 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:47:59.799320 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-25c3fea5-bf25-4661-ae20-5adf7808a6f2 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1573 microversion: 2.1 time: 0.154284 Aug 24 07:47:59.806343 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 436/881] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:47:59 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:48:00.820332 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-5649c6a4-e47a-4b89-ae4c-a52b757de632 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:48:00.820963 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-5649c6a4-e47a-4b89-ae4c-a52b757de632 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:48:00.827255 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5649c6a4-e47a-4b89-ae4c-a52b757de632 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:00.828364 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5649c6a4-e47a-4b89-ae4c-a52b757de632 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:00.828796 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5649c6a4-e47a-4b89-ae4c-a52b757de632 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:00.829479 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5649c6a4-e47a-4b89-ae4c-a52b757de632 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:00.829929 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5649c6a4-e47a-4b89-ae4c-a52b757de632 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:00.830347 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5649c6a4-e47a-4b89-ae4c-a52b757de632 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:00.959292 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-5649c6a4-e47a-4b89-ae4c-a52b757de632 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:00.966892 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-5649c6a4-e47a-4b89-ae4c-a52b757de632 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1573 microversion: 2.1 time: 0.150527 Aug 24 07:48:00.967457 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 446/882] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:48:00 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1573 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:48:01.987797 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-53a3e181-c7b4-4621-91e0-ce17b4f40dd9 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:48:01.988398 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-53a3e181-c7b4-4621-91e0-ce17b4f40dd9 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:48:01.994665 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-53a3e181-c7b4-4621-91e0-ce17b4f40dd9 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:01.995184 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-53a3e181-c7b4-4621-91e0-ce17b4f40dd9 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:01.995614 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-53a3e181-c7b4-4621-91e0-ce17b4f40dd9 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:01.996299 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-53a3e181-c7b4-4621-91e0-ce17b4f40dd9 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:01.996748 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-53a3e181-c7b4-4621-91e0-ce17b4f40dd9 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:01.997162 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-53a3e181-c7b4-4621-91e0-ce17b4f40dd9 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:02.129760 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-53a3e181-c7b4-4621-91e0-ce17b4f40dd9 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:02.137653 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-53a3e181-c7b4-4621-91e0-ce17b4f40dd9 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1573 microversion: 2.1 time: 0.154109 Aug 24 07:48:02.138215 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 437/883] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:48:01 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:48:03.158632 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-13c6f22b-5592-4339-921a-07953f639e0e tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:48:03.159279 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-13c6f22b-5592-4339-921a-07953f639e0e tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:48:03.165597 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-13c6f22b-5592-4339-921a-07953f639e0e tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:03.166067 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-13c6f22b-5592-4339-921a-07953f639e0e tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:03.166490 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-13c6f22b-5592-4339-921a-07953f639e0e tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:03.167196 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-13c6f22b-5592-4339-921a-07953f639e0e tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:03.167644 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-13c6f22b-5592-4339-921a-07953f639e0e tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:03.168059 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-13c6f22b-5592-4339-921a-07953f639e0e tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:03.299298 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-13c6f22b-5592-4339-921a-07953f639e0e tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:03.307076 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-13c6f22b-5592-4339-921a-07953f639e0e tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1573 microversion: 2.1 time: 0.152681 Aug 24 07:48:03.307652 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 447/884] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:48:03 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:48:04.327267 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-a1a236ad-e937-4af8-92fc-f891bb3c8f50 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:48:04.327914 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-a1a236ad-e937-4af8-92fc-f891bb3c8f50 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:48:04.334292 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a1a236ad-e937-4af8-92fc-f891bb3c8f50 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:04.334810 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a1a236ad-e937-4af8-92fc-f891bb3c8f50 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:04.335242 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a1a236ad-e937-4af8-92fc-f891bb3c8f50 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:04.335921 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a1a236ad-e937-4af8-92fc-f891bb3c8f50 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:04.336367 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a1a236ad-e937-4af8-92fc-f891bb3c8f50 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:04.336785 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a1a236ad-e937-4af8-92fc-f891bb3c8f50 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:04.465105 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-a1a236ad-e937-4af8-92fc-f891bb3c8f50 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:04.473248 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-a1a236ad-e937-4af8-92fc-f891bb3c8f50 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1560 microversion: 2.1 time: 0.149743 Aug 24 07:48:04.473808 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 438/885] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:48:04 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:48:08.285946 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-0a787214-8523-4af9-8844-a6893c55fd62 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1411021175", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2141614004", "security_groups": [{"name": "tempest-secgroup-smoke-2065229898"}], "block_device_mapping_v2": [{"uuid": "7fb27edc-183f-4a36-b7fe-0b31978cbda5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6249c133-fde8-4248-b989-66dfa30799de"}]}} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:48:08.395137 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.network.neutron [None req-0a787214-8523-4af9-8844-a6893c55fd62 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] validate_networks() for [('6249c133-fde8-4248-b989-66dfa30799de', None, None, None, None, None)] {{(pid=127114) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 07:48:08.797344 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-0a787214-8523-4af9-8844-a6893c55fd62 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Flavor limits 0:0:0 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 07:48:08.798031 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-0a787214-8523-4af9-8844-a6893c55fd62 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Image limits 0:0:0 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 07:48:08.798730 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-0a787214-8523-4af9-8844-a6893c55fd62 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Flavor pref 0:0:0 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 07:48:08.800830 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-0a787214-8523-4af9-8844-a6893c55fd62 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Image pref 0:0:0 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 07:48:08.801690 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-0a787214-8523-4af9-8844-a6893c55fd62 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 07:48:08.816944 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0a787214-8523-4af9-8844-a6893c55fd62 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:08.818257 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0a787214-8523-4af9-8844-a6893c55fd62 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:08.818923 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0a787214-8523-4af9-8844-a6893c55fd62 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:08.819766 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0a787214-8523-4af9-8844-a6893c55fd62 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:08.820290 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0a787214-8523-4af9-8844-a6893c55fd62 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:08.820964 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0a787214-8523-4af9-8844-a6893c55fd62 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:08.828591 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell1:SELECT=94 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:08.840637 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.quota [None req-0a787214-8523-4af9-8844-a6893c55fd62 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Getting quotas for project e97fd16d61ef4d5ebc5f435ae8a18561. Resources: {'cores', 'ram', 'instances'} {{(pid=127114) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:48:08.845492 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.quota [None req-0a787214-8523-4af9-8844-a6893c55fd62 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Getting quotas for user 760115e8fb554582a016445f9aadc00c and project e97fd16d61ef4d5ebc5f435ae8a18561. Resources: {'cores', 'ram', 'instances'} {{(pid=127114) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:48:08.905014 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-0a787214-8523-4af9-8844-a6893c55fd62 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Going to run 1 instances... {{(pid=127114) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 07:48:08.907829 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-0a787214-8523-4af9-8844-a6893c55fd62 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 24a09aab-9508-4a08-a893-16eec8995ef8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7fb27edc-183f-4a36-b7fe-0b31978cbda5',volume_size=None,volume_type=None)] {{(pid=127114) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 07:48:09.017503 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_api:SELECT=38 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:09.059584 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-0a787214-8523-4af9-8844-a6893c55fd62 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.777206 Aug 24 07:48:09.060391 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 448/886] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 24 07:48:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 07:48:09.075140 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-c206ab55-d097-4417-99f1-92b6ff6e75ad tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:48:09.078610 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-c206ab55-d097-4417-99f1-92b6ff6e75ad tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 24a09aab-9508-4a08-a893-16eec8995ef8] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:48:09.175817 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-c206ab55-d097-4417-99f1-92b6ff6e75ad tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:09.183807 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-c206ab55-d097-4417-99f1-92b6ff6e75ad tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/24a09aab-9508-4a08-a893-16eec8995ef8" status: 200 len: 1095 microversion: 2.1 time: 0.115548 Aug 24 07:48:09.197105 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 439/887] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:48:09 2022] GET /compute/v2.1/servers/24a09aab-9508-4a08-a893-16eec8995ef8 => generated 1095 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:48:10.209028 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-d770cdd0-9fe0-439a-bf42-4ba3bdd1b257 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:48:10.209468 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-d770cdd0-9fe0-439a-bf42-4ba3bdd1b257 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 24a09aab-9508-4a08-a893-16eec8995ef8] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:48:10.216701 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d770cdd0-9fe0-439a-bf42-4ba3bdd1b257 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:10.217172 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d770cdd0-9fe0-439a-bf42-4ba3bdd1b257 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:10.217708 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d770cdd0-9fe0-439a-bf42-4ba3bdd1b257 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:10.219522 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d770cdd0-9fe0-439a-bf42-4ba3bdd1b257 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:10.220262 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d770cdd0-9fe0-439a-bf42-4ba3bdd1b257 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:10.220884 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d770cdd0-9fe0-439a-bf42-4ba3bdd1b257 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:10.298836 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-d770cdd0-9fe0-439a-bf42-4ba3bdd1b257 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:10.307620 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-d770cdd0-9fe0-439a-bf42-4ba3bdd1b257 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/24a09aab-9508-4a08-a893-16eec8995ef8" status: 200 len: 1211 microversion: 2.1 time: 0.106438 Aug 24 07:48:10.308219 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 449/888] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:48:10 2022] GET /compute/v2.1/servers/24a09aab-9508-4a08-a893-16eec8995ef8 => generated 1211 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:48:11.327795 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-e5d83b98-5824-4964-9608-83ab67f4e681 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:48:11.329100 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-e5d83b98-5824-4964-9608-83ab67f4e681 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 24a09aab-9508-4a08-a893-16eec8995ef8] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:48:11.331693 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_api:SELECT=28 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:11.337901 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e5d83b98-5824-4964-9608-83ab67f4e681 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:11.338381 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e5d83b98-5824-4964-9608-83ab67f4e681 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:11.338977 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e5d83b98-5824-4964-9608-83ab67f4e681 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:11.339669 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e5d83b98-5824-4964-9608-83ab67f4e681 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:11.340118 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e5d83b98-5824-4964-9608-83ab67f4e681 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:11.340532 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e5d83b98-5824-4964-9608-83ab67f4e681 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:11.345576 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:11.540848 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-e5d83b98-5824-4964-9608-83ab67f4e681 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:11.549735 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-e5d83b98-5824-4964-9608-83ab67f4e681 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/24a09aab-9508-4a08-a893-16eec8995ef8" status: 200 len: 1267 microversion: 2.1 time: 0.225766 Aug 24 07:48:11.550312 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 440/889] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:48:11 2022] GET /compute/v2.1/servers/24a09aab-9508-4a08-a893-16eec8995ef8 => generated 1267 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:48:11.619491 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [req-22694a4d-2021-4b12-982f-e534f62a9032 req-861dd44e-4a44-4495-8fce-59da2b683b3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24a09aab-9508-4a08-a893-16eec8995ef8", "tag": "c8813b7c-1c4b-464a-827b-33d862491a33"}]} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:48:11.651133 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-22694a4d-2021-4b12-982f-e534f62a9032 req-861dd44e-4a44-4495-8fce-59da2b683b3f service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:11.651684 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-22694a4d-2021-4b12-982f-e534f62a9032 req-861dd44e-4a44-4495-8fce-59da2b683b3f service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:11.652181 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-22694a4d-2021-4b12-982f-e534f62a9032 req-861dd44e-4a44-4495-8fce-59da2b683b3f service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:11.679160 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.compute.server_external_events [req-22694a4d-2021-4b12-982f-e534f62a9032 req-861dd44e-4a44-4495-8fce-59da2b683b3f service nova] Creating event network-changed:c8813b7c-1c4b-464a-827b-33d862491a33 for instance 24a09aab-9508-4a08-a893-16eec8995ef8 on hv-cinder-85427 Aug 24 07:48:11.689743 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [req-22694a4d-2021-4b12-982f-e534f62a9032 req-861dd44e-4a44-4495-8fce-59da2b683b3f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074045 Aug 24 07:48:11.690330 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 450/890] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:48:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:48:12.570552 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-d9387c9d-d833-4667-8bc4-759ebd56bfa2 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:48:12.571212 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-d9387c9d-d833-4667-8bc4-759ebd56bfa2 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 24a09aab-9508-4a08-a893-16eec8995ef8] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:48:12.578633 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d9387c9d-d833-4667-8bc4-759ebd56bfa2 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:12.579160 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d9387c9d-d833-4667-8bc4-759ebd56bfa2 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:12.579586 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d9387c9d-d833-4667-8bc4-759ebd56bfa2 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:12.580501 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d9387c9d-d833-4667-8bc4-759ebd56bfa2 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:12.581123 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d9387c9d-d833-4667-8bc4-759ebd56bfa2 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:12.581550 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d9387c9d-d833-4667-8bc4-759ebd56bfa2 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:12.869678 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-d9387c9d-d833-4667-8bc4-759ebd56bfa2 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:12.878493 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-d9387c9d-d833-4667-8bc4-759ebd56bfa2 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/24a09aab-9508-4a08-a893-16eec8995ef8" status: 200 len: 1267 microversion: 2.1 time: 0.311671 Aug 24 07:48:12.879098 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 441/891] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:48:12 2022] GET /compute/v2.1/servers/24a09aab-9508-4a08-a893-16eec8995ef8 => generated 1267 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:48:13.900399 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-65897c91-fca8-444b-bf58-4ca97d45fce1 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:48:13.901187 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-65897c91-fca8-444b-bf58-4ca97d45fce1 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 24a09aab-9508-4a08-a893-16eec8995ef8] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:48:13.908025 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-65897c91-fca8-444b-bf58-4ca97d45fce1 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:13.908515 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-65897c91-fca8-444b-bf58-4ca97d45fce1 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:13.909003 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-65897c91-fca8-444b-bf58-4ca97d45fce1 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:13.909734 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-65897c91-fca8-444b-bf58-4ca97d45fce1 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:13.910188 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-65897c91-fca8-444b-bf58-4ca97d45fce1 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:13.910607 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-65897c91-fca8-444b-bf58-4ca97d45fce1 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:14.052401 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-65897c91-fca8-444b-bf58-4ca97d45fce1 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:14.061226 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-65897c91-fca8-444b-bf58-4ca97d45fce1 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/24a09aab-9508-4a08-a893-16eec8995ef8" status: 200 len: 1267 microversion: 2.1 time: 0.165799 Aug 24 07:48:14.063914 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 451/892] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:48:13 2022] GET /compute/v2.1/servers/24a09aab-9508-4a08-a893-16eec8995ef8 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:48:14.282370 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-e0ccc0fe-9e9a-47d1-bdaa-ed6c80103336 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:48:14.282924 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-e0ccc0fe-9e9a-47d1-bdaa-ed6c80103336 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:48:14.289053 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e0ccc0fe-9e9a-47d1-bdaa-ed6c80103336 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:14.289719 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e0ccc0fe-9e9a-47d1-bdaa-ed6c80103336 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:14.290145 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e0ccc0fe-9e9a-47d1-bdaa-ed6c80103336 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:14.290882 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e0ccc0fe-9e9a-47d1-bdaa-ed6c80103336 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:14.291326 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e0ccc0fe-9e9a-47d1-bdaa-ed6c80103336 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:14.291749 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e0ccc0fe-9e9a-47d1-bdaa-ed6c80103336 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:14.321541 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-e0ccc0fe-9e9a-47d1-bdaa-ed6c80103336 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651/os-volume_attachments/73d8df03-e088-42da-8590-5b4612de87dd" status: 200 len: 194 microversion: 2.20 time: 0.043242 Aug 24 07:48:14.322212 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 442/893] 10.222.0.42 () {60 vars in 1454 bytes} [Wed Aug 24 07:48:14 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651/os-volume_attachments/73d8df03-e088-42da-8590-5b4612de87dd => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 07:48:14.390579 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-488c1a71-a503-43f8-98d0-468588281d59 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:48:14.391086 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-488c1a71-a503-43f8-98d0-468588281d59 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:48:14.396764 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-488c1a71-a503-43f8-98d0-468588281d59 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:14.397244 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-488c1a71-a503-43f8-98d0-468588281d59 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:14.397671 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-488c1a71-a503-43f8-98d0-468588281d59 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:14.398356 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-488c1a71-a503-43f8-98d0-468588281d59 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:14.398845 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-488c1a71-a503-43f8-98d0-468588281d59 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:14.399267 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-488c1a71-a503-43f8-98d0-468588281d59 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:14.484980 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.objects.instance [None req-488c1a71-a503-43f8-98d0-468588281d59 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lazy-loading 'services' on Instance uuid a80b309c-fa06-43b7-be57-1dc3045b9651 {{(pid=127114) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:48:14.556772 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-488c1a71-a503-43f8-98d0-468588281d59 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651/os-volume_attachments/73d8df03-e088-42da-8590-5b4612de87dd" status: 202 len: 0 microversion: 2.20 time: 0.169998 Aug 24 07:48:14.557420 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 452/894] 10.222.0.42 () {60 vars in 1457 bytes} [Wed Aug 24 07:48:14 2022] DELETE /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651/os-volume_attachments/73d8df03-e088-42da-8590-5b4612de87dd => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 07:48:14.566214 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-eac802d1-0c06-442a-b932-f499cefbe019 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:48:14.568703 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-eac802d1-0c06-442a-b932-f499cefbe019 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:48:14.575257 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-eac802d1-0c06-442a-b932-f499cefbe019 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:14.575669 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-eac802d1-0c06-442a-b932-f499cefbe019 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:14.576280 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-eac802d1-0c06-442a-b932-f499cefbe019 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:14.577086 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-eac802d1-0c06-442a-b932-f499cefbe019 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:14.578082 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-eac802d1-0c06-442a-b932-f499cefbe019 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:14.578666 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-eac802d1-0c06-442a-b932-f499cefbe019 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:14.613303 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-eac802d1-0c06-442a-b932-f499cefbe019 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051434 Aug 24 07:48:14.613863 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 443/895] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 24 07:48:14 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 07:48:15.086064 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-5256f131-19f0-4709-b37a-d1bc2dc50329 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:48:15.086836 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-5256f131-19f0-4709-b37a-d1bc2dc50329 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 24a09aab-9508-4a08-a893-16eec8995ef8] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:48:15.093351 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5256f131-19f0-4709-b37a-d1bc2dc50329 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:15.094012 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5256f131-19f0-4709-b37a-d1bc2dc50329 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:15.094455 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5256f131-19f0-4709-b37a-d1bc2dc50329 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:15.095183 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5256f131-19f0-4709-b37a-d1bc2dc50329 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:15.095634 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5256f131-19f0-4709-b37a-d1bc2dc50329 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:15.096221 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5256f131-19f0-4709-b37a-d1bc2dc50329 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:15.237320 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-5256f131-19f0-4709-b37a-d1bc2dc50329 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:15.245498 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-5256f131-19f0-4709-b37a-d1bc2dc50329 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/24a09aab-9508-4a08-a893-16eec8995ef8" status: 200 len: 1267 microversion: 2.1 time: 0.165067 Aug 24 07:48:15.246094 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 453/896] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:48:15 2022] GET /compute/v2.1/servers/24a09aab-9508-4a08-a893-16eec8995ef8 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:48:15.625556 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-de3e4c19-9c0a-43aa-83fb-2dc64425154b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:48:15.627728 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-de3e4c19-9c0a-43aa-83fb-2dc64425154b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:48:15.634235 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-de3e4c19-9c0a-43aa-83fb-2dc64425154b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:15.634646 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-de3e4c19-9c0a-43aa-83fb-2dc64425154b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:15.635115 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-de3e4c19-9c0a-43aa-83fb-2dc64425154b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:15.635804 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-de3e4c19-9c0a-43aa-83fb-2dc64425154b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:15.636255 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-de3e4c19-9c0a-43aa-83fb-2dc64425154b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:15.636675 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-de3e4c19-9c0a-43aa-83fb-2dc64425154b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:15.666708 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-de3e4c19-9c0a-43aa-83fb-2dc64425154b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045034 Aug 24 07:48:15.667281 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 444/897] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 24 07:48:15 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:48:15.729968 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-392167a7-f8df-4ce6-8baf-12d324fb600f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:48:15.730469 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-392167a7-f8df-4ce6-8baf-12d324fb600f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:48:15.736528 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-392167a7-f8df-4ce6-8baf-12d324fb600f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:15.737009 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-392167a7-f8df-4ce6-8baf-12d324fb600f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:15.737446 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-392167a7-f8df-4ce6-8baf-12d324fb600f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:15.738143 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-392167a7-f8df-4ce6-8baf-12d324fb600f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:15.738599 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-392167a7-f8df-4ce6-8baf-12d324fb600f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:15.739043 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-392167a7-f8df-4ce6-8baf-12d324fb600f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:15.764192 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-392167a7-f8df-4ce6-8baf-12d324fb600f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Going to try to terminate instance {{(pid=127114) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 07:48:15.845900 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-392167a7-f8df-4ce6-8baf-12d324fb600f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 204 len: 0 microversion: 2.20 time: 0.118466 Aug 24 07:48:15.846884 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 454/898] 10.222.0.42 () {60 vars in 1280 bytes} [Wed Aug 24 07:48:15 2022] DELETE /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 07:48:15.854802 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-4733ca8d-470c-4aeb-913f-96f4d70ac39c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:48:15.855414 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-4733ca8d-470c-4aeb-913f-96f4d70ac39c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:48:15.861808 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4733ca8d-470c-4aeb-913f-96f4d70ac39c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:15.862293 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4733ca8d-470c-4aeb-913f-96f4d70ac39c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:15.862744 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4733ca8d-470c-4aeb-913f-96f4d70ac39c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:15.864421 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4733ca8d-470c-4aeb-913f-96f4d70ac39c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:15.865080 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4733ca8d-470c-4aeb-913f-96f4d70ac39c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:15.865611 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4733ca8d-470c-4aeb-913f-96f4d70ac39c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:16.006547 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-4733ca8d-470c-4aeb-913f-96f4d70ac39c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:16.015037 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-4733ca8d-470c-4aeb-913f-96f4d70ac39c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:16.016520 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-4733ca8d-470c-4aeb-913f-96f4d70ac39c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:16.017656 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-4733ca8d-470c-4aeb-913f-96f4d70ac39c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1724 microversion: 2.20 time: 0.166840 Aug 24 07:48:16.018206 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 445/899] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:48:15 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:48:16.268278 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-d0dd03b4-b187-4ecf-8b07-b80b6939ce9b tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:48:16.269784 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-d0dd03b4-b187-4ecf-8b07-b80b6939ce9b tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 24a09aab-9508-4a08-a893-16eec8995ef8] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:48:16.276266 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d0dd03b4-b187-4ecf-8b07-b80b6939ce9b tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:16.276748 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d0dd03b4-b187-4ecf-8b07-b80b6939ce9b tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:16.277191 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d0dd03b4-b187-4ecf-8b07-b80b6939ce9b tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:16.277884 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d0dd03b4-b187-4ecf-8b07-b80b6939ce9b tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:16.278342 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d0dd03b4-b187-4ecf-8b07-b80b6939ce9b tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:16.278792 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d0dd03b4-b187-4ecf-8b07-b80b6939ce9b tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:16.447525 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-d0dd03b4-b187-4ecf-8b07-b80b6939ce9b tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:16.455667 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-d0dd03b4-b187-4ecf-8b07-b80b6939ce9b tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/24a09aab-9508-4a08-a893-16eec8995ef8" status: 200 len: 1267 microversion: 2.1 time: 0.192202 Aug 24 07:48:16.456229 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 455/900] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:48:16 2022] GET /compute/v2.1/servers/24a09aab-9508-4a08-a893-16eec8995ef8 => generated 1267 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:48:17.040708 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-17fc26f7-1edb-460b-8c35-ee0144301e73 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:48:17.041402 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-17fc26f7-1edb-460b-8c35-ee0144301e73 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:48:17.048492 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-17fc26f7-1edb-460b-8c35-ee0144301e73 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:17.048963 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-17fc26f7-1edb-460b-8c35-ee0144301e73 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:17.049426 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-17fc26f7-1edb-460b-8c35-ee0144301e73 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:17.050077 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-17fc26f7-1edb-460b-8c35-ee0144301e73 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:17.050473 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-17fc26f7-1edb-460b-8c35-ee0144301e73 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:17.050928 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-17fc26f7-1edb-460b-8c35-ee0144301e73 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:17.187496 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-17fc26f7-1edb-460b-8c35-ee0144301e73 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:17.195824 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-17fc26f7-1edb-460b-8c35-ee0144301e73 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:17.197325 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-17fc26f7-1edb-460b-8c35-ee0144301e73 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:17.198470 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-17fc26f7-1edb-460b-8c35-ee0144301e73 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1724 microversion: 2.20 time: 0.161674 Aug 24 07:48:17.199059 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 446/901] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:48:17 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:48:17.476452 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-2f895d50-e17b-43b1-ad6b-89fdc6b112a5 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:48:17.477068 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-2f895d50-e17b-43b1-ad6b-89fdc6b112a5 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 24a09aab-9508-4a08-a893-16eec8995ef8] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:48:17.484404 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2f895d50-e17b-43b1-ad6b-89fdc6b112a5 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:17.484958 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2f895d50-e17b-43b1-ad6b-89fdc6b112a5 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:17.485464 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2f895d50-e17b-43b1-ad6b-89fdc6b112a5 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:17.486163 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2f895d50-e17b-43b1-ad6b-89fdc6b112a5 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:17.486613 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2f895d50-e17b-43b1-ad6b-89fdc6b112a5 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:17.487064 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2f895d50-e17b-43b1-ad6b-89fdc6b112a5 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:17.642787 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-2f895d50-e17b-43b1-ad6b-89fdc6b112a5 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:17.650566 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-2f895d50-e17b-43b1-ad6b-89fdc6b112a5 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/24a09aab-9508-4a08-a893-16eec8995ef8" status: 200 len: 1267 microversion: 2.1 time: 0.177816 Aug 24 07:48:17.651276 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 456/902] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:48:17 2022] GET /compute/v2.1/servers/24a09aab-9508-4a08-a893-16eec8995ef8 => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:48:18.224379 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-ae74f365-4e81-473e-a76e-69213f3fb81b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:48:18.225021 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-ae74f365-4e81-473e-a76e-69213f3fb81b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:48:18.231718 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ae74f365-4e81-473e-a76e-69213f3fb81b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:18.232202 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ae74f365-4e81-473e-a76e-69213f3fb81b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:18.232903 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ae74f365-4e81-473e-a76e-69213f3fb81b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:18.233606 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ae74f365-4e81-473e-a76e-69213f3fb81b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:18.234143 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ae74f365-4e81-473e-a76e-69213f3fb81b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:18.234492 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ae74f365-4e81-473e-a76e-69213f3fb81b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:18.560806 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-ae74f365-4e81-473e-a76e-69213f3fb81b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:18.570312 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-ae74f365-4e81-473e-a76e-69213f3fb81b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:18.572070 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-ae74f365-4e81-473e-a76e-69213f3fb81b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:18.573287 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-ae74f365-4e81-473e-a76e-69213f3fb81b tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1724 microversion: 2.20 time: 0.352906 Aug 24 07:48:18.573952 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 447/903] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:48:18 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1724 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:48:18.672597 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-2c68ea7f-5cfb-4405-856d-e11a452a1e24 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:48:18.673310 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-2c68ea7f-5cfb-4405-856d-e11a452a1e24 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 24a09aab-9508-4a08-a893-16eec8995ef8] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:48:18.681599 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2c68ea7f-5cfb-4405-856d-e11a452a1e24 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:18.682417 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2c68ea7f-5cfb-4405-856d-e11a452a1e24 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:18.683829 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2c68ea7f-5cfb-4405-856d-e11a452a1e24 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:18.684781 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2c68ea7f-5cfb-4405-856d-e11a452a1e24 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:18.685453 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2c68ea7f-5cfb-4405-856d-e11a452a1e24 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:18.686108 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2c68ea7f-5cfb-4405-856d-e11a452a1e24 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:18.829657 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell0:SELECT=2 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:18.845943 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-2c68ea7f-5cfb-4405-856d-e11a452a1e24 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:18.853065 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell0:SELECT=6 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:18.856423 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-2c68ea7f-5cfb-4405-856d-e11a452a1e24 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/24a09aab-9508-4a08-a893-16eec8995ef8" status: 200 len: 1267 microversion: 2.1 time: 0.188554 Aug 24 07:48:18.860454 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 457/904] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:48:18 2022] GET /compute/v2.1/servers/24a09aab-9508-4a08-a893-16eec8995ef8 => generated 1267 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:48:19.437945 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [req-79719402-bcf2-4d70-968f-00796f9fadd4 req-f1407c14-c052-43ed-b367-22b48ceae86a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a80b309c-fa06-43b7-be57-1dc3045b9651", "name": "network-vif-deleted", "tag": "581e55c1-7b9e-4284-8d45-c0506fd756f1"}]} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:48:19.445364 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell0:SELECT=2 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:19.458235 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-79719402-bcf2-4d70-968f-00796f9fadd4 req-f1407c14-c052-43ed-b367-22b48ceae86a service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:19.458235 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-79719402-bcf2-4d70-968f-00796f9fadd4 req-f1407c14-c052-43ed-b367-22b48ceae86a service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:19.458235 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-79719402-bcf2-4d70-968f-00796f9fadd4 req-f1407c14-c052-43ed-b367-22b48ceae86a service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:19.474883 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.compute.server_external_events [req-79719402-bcf2-4d70-968f-00796f9fadd4 req-f1407c14-c052-43ed-b367-22b48ceae86a service nova] Creating event network-vif-deleted:581e55c1-7b9e-4284-8d45-c0506fd756f1 for instance a80b309c-fa06-43b7-be57-1dc3045b9651 on hv-cinder-85427 Aug 24 07:48:19.483927 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [req-79719402-bcf2-4d70-968f-00796f9fadd4 req-f1407c14-c052-43ed-b367-22b48ceae86a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049261 Aug 24 07:48:19.485361 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 448/905] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:48:19.599118 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-6d541cd6-e8ee-4804-bfae-b27ab11d11d3 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:48:19.599921 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-6d541cd6-e8ee-4804-bfae-b27ab11d11d3 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:48:19.618120 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6d541cd6-e8ee-4804-bfae-b27ab11d11d3 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:19.621013 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6d541cd6-e8ee-4804-bfae-b27ab11d11d3 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:19.643519 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6d541cd6-e8ee-4804-bfae-b27ab11d11d3 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:19.646827 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6d541cd6-e8ee-4804-bfae-b27ab11d11d3 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:19.647411 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6d541cd6-e8ee-4804-bfae-b27ab11d11d3 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:19.647862 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6d541cd6-e8ee-4804-bfae-b27ab11d11d3 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:19.701585 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6d541cd6-e8ee-4804-bfae-b27ab11d11d3 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:19.703309 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6d541cd6-e8ee-4804-bfae-b27ab11d11d3 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:19.703941 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6d541cd6-e8ee-4804-bfae-b27ab11d11d3 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:19.704558 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.objects.instance [None req-6d541cd6-e8ee-4804-bfae-b27ab11d11d3 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lazy-loading 'fault' on Instance uuid a80b309c-fa06-43b7-be57-1dc3045b9651 {{(pid=127114) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:48:19.750440 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-6d541cd6-e8ee-4804-bfae-b27ab11d11d3 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:19.759591 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-6d541cd6-e8ee-4804-bfae-b27ab11d11d3 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:19.761586 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-6d541cd6-e8ee-4804-bfae-b27ab11d11d3 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:19.763134 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-6d541cd6-e8ee-4804-bfae-b27ab11d11d3 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 200 len: 1371 microversion: 2.20 time: 0.169474 Aug 24 07:48:19.764180 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 458/906] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:48:19 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:48:19.883359 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-3c650457-5930-434e-bf2a-bf2040eb0f5f tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:48:19.884493 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-3c650457-5930-434e-bf2a-bf2040eb0f5f tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 24a09aab-9508-4a08-a893-16eec8995ef8] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:48:19.892224 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3c650457-5930-434e-bf2a-bf2040eb0f5f tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:19.893337 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3c650457-5930-434e-bf2a-bf2040eb0f5f tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:19.894489 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3c650457-5930-434e-bf2a-bf2040eb0f5f tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:19.895210 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3c650457-5930-434e-bf2a-bf2040eb0f5f tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:19.895891 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3c650457-5930-434e-bf2a-bf2040eb0f5f tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:19.896982 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3c650457-5930-434e-bf2a-bf2040eb0f5f tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:20.083193 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-3c650457-5930-434e-bf2a-bf2040eb0f5f tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:20.093170 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-3c650457-5930-434e-bf2a-bf2040eb0f5f tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/24a09aab-9508-4a08-a893-16eec8995ef8" status: 200 len: 1267 microversion: 2.1 time: 0.215373 Aug 24 07:48:20.094781 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 449/907] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:48:19 2022] GET /compute/v2.1/servers/24a09aab-9508-4a08-a893-16eec8995ef8 => generated 1267 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:48:20.786889 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-931118ef-e794-4fa0-9e07-b73d4a8a9c4a tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:48:20.787503 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-931118ef-e794-4fa0-9e07-b73d4a8a9c4a tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:48:20.794090 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-931118ef-e794-4fa0-9e07-b73d4a8a9c4a tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:20.794568 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-931118ef-e794-4fa0-9e07-b73d4a8a9c4a tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:20.795025 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-931118ef-e794-4fa0-9e07-b73d4a8a9c4a tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:20.795719 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-931118ef-e794-4fa0-9e07-b73d4a8a9c4a tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:20.796310 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-931118ef-e794-4fa0-9e07-b73d4a8a9c4a tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:20.797019 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-931118ef-e794-4fa0-9e07-b73d4a8a9c4a tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:20.812032 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.wsgi [None req-931118ef-e794-4fa0-9e07-b73d4a8a9c4a tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] HTTP exception thrown: Instance a80b309c-fa06-43b7-be57-1dc3045b9651 could not be found. Aug 24 07:48:20.813716 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-931118ef-e794-4fa0-9e07-b73d4a8a9c4a tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Request method failure captured: Aug 24 07:48:20.813716 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: request: GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 HTTP/1.1 Aug 24 07:48:20.813716 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept: application/json Aug 24 07:48:20.813716 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept-Encoding: identity Aug 24 07:48:20.813716 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Connection: close Aug 24 07:48:20.813716 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Length: 0 Aug 24 07:48:20.813716 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Type: application/json Aug 24 07:48:20.813716 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Host: 10.222.0.42 Aug 24 07:48:20.813716 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Openstack-System-Scope: None Aug 24 07:48:20.813716 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: User-Agent: python-urllib3/1.26.11 Aug 24 07:48:20.813716 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Auth-Token: gAAAAABjBdchmpAN70V5S3VyWq-C0dEmtA0zbwloeE-Z1d9F-hOycCodaGDVQkA5LsmJI6w02SIt58llNqBDCvbJzYE0qrrp8T3JeywroS8d_FGt167TbjpygWiMdKJLgWiPP7b4W3K-XByeGhWcHBgbAVRhClDbTLiuqysIOLKi-8c-Il1OZtI Aug 24 07:48:20.813716 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Id: None Aug 24 07:48:20.813716 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Name: None Aug 24 07:48:20.813716 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Identity-Status: Confirmed Aug 24 07:48:20.813716 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Is-Admin-Project: True Aug 24 07:48:20.813716 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 07:48:20.813716 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Id: default Aug 24 07:48:20.813716 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Name: Default Aug 24 07:48:20.813716 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Id: 337840b04c0b4135a83063dfc5dbe5f1 Aug 24 07:48:20.813716 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1796398509 Aug 24 07:48:20.813716 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Role: reader,member Aug 24 07:48:20.813716 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Roles: reader,member Aug 24 07:48:20.815234 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/337840b04c0b4135a83063dfc5dbe5f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_337840b04c0b4135a83063dfc5dbe5f1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/337840b04c0b4135a83063dfc5dbe5f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/337840b04c0b4135a83063dfc5dbe5f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:48:20.815234 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1796398509 Aug 24 07:48:20.815234 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Id: 337840b04c0b4135a83063dfc5dbe5f1 Aug 24 07:48:20.815234 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1796398509 Aug 24 07:48:20.815234 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User: tempest-AttachVolumeShelveTestJSON-1796398509-project Aug 24 07:48:20.815234 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Id: default Aug 24 07:48:20.815234 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Name: Default Aug 24 07:48:20.815234 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Id: a986ecc6e2644db8be8958b1eacfd5d6 Aug 24 07:48:20.815234 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1796398509-project Aug 24 07:48:20.815234 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: method: > Aug 24 07:48:20.815234 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: exception: Instance a80b309c-fa06-43b7-be57-1dc3045b9651 could not be found. Aug 24 07:48:20.815234 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: action_args: {'id': 'a80b309c-fa06-43b7-be57-1dc3045b9651'} Aug 24 07:48:20.816045 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:48:20.816045 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:48:20.816045 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:48:20.816045 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:48:20.816045 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:48:20.816045 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:48:20.816045 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:48:20.816045 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:48:20.816045 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:48:20.816045 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:48:20.816045 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a80b309c-fa06-43b7-be57-1dc3045b9651 could not be found. Aug 24 07:48:20.816045 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:48:20.816045 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:48:20.816045 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:48:20.816045 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:48:20.816045 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:48:20.816045 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:48:20.816045 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:48:20.816045 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:48:20.816045 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:48:20.817497 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:48:20.817497 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 07:48:20.817497 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 07:48:20.817497 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:48:20.817497 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:48:20.817497 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:48:20.817497 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:48:20.817497 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a80b309c-fa06-43b7-be57-1dc3045b9651 could not be found. Aug 24 07:48:20.817497 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:48:20.817497 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:48:20.817497 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:48:20.817497 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:48:20.817497 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:48:20.817497 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:48:20.817497 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:48:20.817497 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:48:20.817497 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a80b309c-fa06-43b7-be57-1dc3045b9651 could not be found. Aug 24 07:48:20.817497 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:48:20.819074 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-931118ef-e794-4fa0-9e07-b73d4a8a9c4a tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Returning 404 to user: Instance a80b309c-fa06-43b7-be57-1dc3045b9651 could not be found. {{(pid=127114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:48:20.819074 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-931118ef-e794-4fa0-9e07-b73d4a8a9c4a tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 404 len: 111 microversion: 2.20 time: 0.032604 Aug 24 07:48:20.819074 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 459/908] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:48:20 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 07:48:20.824491 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-2f2e0ff9-cd4b-492f-89a1-e13d45b2b100 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '.version_select at 0x7faf5bb6b940>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:48:20.847228 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-2f2e0ff9-cd4b-492f-89a1-e13d45b2b100 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1301067892" status: 204 len: 0 microversion: 2.20 time: 0.026379 Aug 24 07:48:20.847924 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 450/909] 10.222.0.42 () {60 vars in 1262 bytes} [Wed Aug 24 07:48:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1301067892 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 07:48:21.117820 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-b5754d53-1800-4a18-959e-5343559a9ed1 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:48:21.118354 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-b5754d53-1800-4a18-959e-5343559a9ed1 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 24a09aab-9508-4a08-a893-16eec8995ef8] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:48:21.124666 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b5754d53-1800-4a18-959e-5343559a9ed1 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:21.125129 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b5754d53-1800-4a18-959e-5343559a9ed1 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:21.125556 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b5754d53-1800-4a18-959e-5343559a9ed1 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:21.126249 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b5754d53-1800-4a18-959e-5343559a9ed1 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:21.126719 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b5754d53-1800-4a18-959e-5343559a9ed1 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:21.127139 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b5754d53-1800-4a18-959e-5343559a9ed1 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:21.259496 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-b5754d53-1800-4a18-959e-5343559a9ed1 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:21.268494 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-b5754d53-1800-4a18-959e-5343559a9ed1 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/24a09aab-9508-4a08-a893-16eec8995ef8" status: 200 len: 1267 microversion: 2.1 time: 0.154894 Aug 24 07:48:21.269233 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 460/910] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:48:21 2022] GET /compute/v2.1/servers/24a09aab-9508-4a08-a893-16eec8995ef8 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:48:21.452298 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [req-5e17655c-c242-4764-bb38-434b277801f5 req-cfabd563-2280-4c8f-83f1-acce8e1d70f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24a09aab-9508-4a08-a893-16eec8995ef8", "name": "network-vif-plugged", "status": "completed", "tag": "c8813b7c-1c4b-464a-827b-33d862491a33"}]} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:48:21.467582 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-5e17655c-c242-4764-bb38-434b277801f5 req-cfabd563-2280-4c8f-83f1-acce8e1d70f4 service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:21.468401 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-5e17655c-c242-4764-bb38-434b277801f5 req-cfabd563-2280-4c8f-83f1-acce8e1d70f4 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:21.468952 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-5e17655c-c242-4764-bb38-434b277801f5 req-cfabd563-2280-4c8f-83f1-acce8e1d70f4 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:21.479498 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.compute.server_external_events [req-5e17655c-c242-4764-bb38-434b277801f5 req-cfabd563-2280-4c8f-83f1-acce8e1d70f4 service nova] Creating event network-vif-plugged:c8813b7c-1c4b-464a-827b-33d862491a33 for instance 24a09aab-9508-4a08-a893-16eec8995ef8 on hv-cinder-85427 Aug 24 07:48:21.485183 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [req-5e17655c-c242-4764-bb38-434b277801f5 req-cfabd563-2280-4c8f-83f1-acce8e1d70f4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038309 Aug 24 07:48:21.485965 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 451/911] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:48:21.490155 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-9bbd7d38-bee3-42c0-9272-b96db1168831 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Action: 'create', calling method: .version_select at 0x7faf684ca310>, body: {"keypair": {"name": "tempest-keypair-1624962031", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGLAGrDyB//NlJfW9C4dQbwczw68zWdH3nxum7e26amrzElADgqYqbwUBTOFC8Qx9RoR1+zPxrs3fc3BtEJSTYmpLzYJPePZjjoF/OdXgKrOKqFxRzXM6QWDdbVur1b+w=="}} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:48:21.507549 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.quota [None req-9bbd7d38-bee3-42c0-9272-b96db1168831 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Getting quotas for project 337840b04c0b4135a83063dfc5dbe5f1. Resources: {'key_pairs'} {{(pid=127114) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:48:21.511715 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.quota [None req-9bbd7d38-bee3-42c0-9272-b96db1168831 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Getting quotas for user a986ecc6e2644db8be8958b1eacfd5d6 and project 337840b04c0b4135a83063dfc5dbe5f1. Resources: {'key_pairs'} {{(pid=127114) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:48:21.535660 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-9bbd7d38-bee3-42c0-9272-b96db1168831 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.053274 Aug 24 07:48:21.536427 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 461/912] 10.222.0.42 () {62 vars in 1200 bytes} [Wed Aug 24 07:48:21 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 55 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 07:48:22.290412 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-631c3577-cf5a-4d00-8002-75cd6c4d48b7 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:48:22.291243 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-631c3577-cf5a-4d00-8002-75cd6c4d48b7 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 24a09aab-9508-4a08-a893-16eec8995ef8] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:48:22.298061 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-631c3577-cf5a-4d00-8002-75cd6c4d48b7 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:22.298537 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-631c3577-cf5a-4d00-8002-75cd6c4d48b7 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:22.298986 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-631c3577-cf5a-4d00-8002-75cd6c4d48b7 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:22.299673 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-631c3577-cf5a-4d00-8002-75cd6c4d48b7 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:22.300121 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-631c3577-cf5a-4d00-8002-75cd6c4d48b7 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:22.300538 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-631c3577-cf5a-4d00-8002-75cd6c4d48b7 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:22.676087 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-631c3577-cf5a-4d00-8002-75cd6c4d48b7 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:22.683732 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-631c3577-cf5a-4d00-8002-75cd6c4d48b7 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/24a09aab-9508-4a08-a893-16eec8995ef8" status: 200 len: 1267 microversion: 2.1 time: 0.398105 Aug 24 07:48:22.684296 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 452/913] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:48:22 2022] GET /compute/v2.1/servers/24a09aab-9508-4a08-a893-16eec8995ef8 => generated 1267 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:48:22.914368 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-e477d5be-6295-40ec-96d9-944da7a3ef7f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1676427036", "imageRef": "4358f547-a499-43f3-9c84-925d78cd73db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "69ae7914-d436-40d2-8731-86f4a5b9b674"}], "security_groups": [{"name": "tempest-securitygroup--428428221"}], "key_name": "tempest-keypair-1624962031", "user_data": "}} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:48:23.014318 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.network.neutron [None req-e477d5be-6295-40ec-96d9-944da7a3ef7f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] validate_networks() for [('69ae7914-d436-40d2-8731-86f4a5b9b674', None, None, None, None, None)] {{(pid=127114) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 07:48:23.387788 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-e477d5be-6295-40ec-96d9-944da7a3ef7f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Flavor limits 0:0:0 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 07:48:23.388209 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-e477d5be-6295-40ec-96d9-944da7a3ef7f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Image limits 0:0:0 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 07:48:23.388678 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-e477d5be-6295-40ec-96d9-944da7a3ef7f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Flavor pref 0:0:0 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 07:48:23.389089 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-e477d5be-6295-40ec-96d9-944da7a3ef7f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Image pref 0:0:0 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 07:48:23.389497 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-e477d5be-6295-40ec-96d9-944da7a3ef7f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 07:48:23.399140 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e477d5be-6295-40ec-96d9-944da7a3ef7f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:23.399608 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e477d5be-6295-40ec-96d9-944da7a3ef7f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:23.400034 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e477d5be-6295-40ec-96d9-944da7a3ef7f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:23.400779 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e477d5be-6295-40ec-96d9-944da7a3ef7f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:23.401226 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e477d5be-6295-40ec-96d9-944da7a3ef7f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:23.401643 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e477d5be-6295-40ec-96d9-944da7a3ef7f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:23.417680 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.quota [None req-e477d5be-6295-40ec-96d9-944da7a3ef7f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Getting quotas for project 337840b04c0b4135a83063dfc5dbe5f1. Resources: {'cores', 'ram', 'instances'} {{(pid=127114) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:48:23.421924 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.quota [None req-e477d5be-6295-40ec-96d9-944da7a3ef7f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Getting quotas for user a986ecc6e2644db8be8958b1eacfd5d6 and project 337840b04c0b4135a83063dfc5dbe5f1. Resources: {'cores', 'ram', 'instances'} {{(pid=127114) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:48:23.433107 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-e477d5be-6295-40ec-96d9-944da7a3ef7f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Going to run 1 instances... {{(pid=127114) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 07:48:23.435109 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-e477d5be-6295-40ec-96d9-944da7a3ef7f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4358f547-a499-43f3-9c84-925d78cd73db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127114) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 07:48:23.480612 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-e477d5be-6295-40ec-96d9-944da7a3ef7f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.570944 Aug 24 07:48:23.481251 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 462/914] 10.222.0.42 () {62 vars in 1188 bytes} [Wed Aug 24 07:48:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 07:48:23.492090 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-eaddd97c-1dc2-4397-8e9e-095e373861f5 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:48:23.492690 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-eaddd97c-1dc2-4397-8e9e-095e373861f5 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:48:23.546407 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-eaddd97c-1dc2-4397-8e9e-095e373861f5 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:23.554006 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-eaddd97c-1dc2-4397-8e9e-095e373861f5 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:23.555532 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-eaddd97c-1dc2-4397-8e9e-095e373861f5 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:23.557835 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-eaddd97c-1dc2-4397-8e9e-095e373861f5 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1282 microversion: 2.20 time: 0.068601 Aug 24 07:48:23.572922 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 453/915] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:48:23 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1282 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:48:23.703583 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-bc1b2c51-4efd-4f06-826e-ca9c7407a61b tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:48:23.704304 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-bc1b2c51-4efd-4f06-826e-ca9c7407a61b tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 24a09aab-9508-4a08-a893-16eec8995ef8] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:48:23.711264 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-bc1b2c51-4efd-4f06-826e-ca9c7407a61b tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:23.711755 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-bc1b2c51-4efd-4f06-826e-ca9c7407a61b tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:23.712166 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-bc1b2c51-4efd-4f06-826e-ca9c7407a61b tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:23.712888 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-bc1b2c51-4efd-4f06-826e-ca9c7407a61b tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:23.713340 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-bc1b2c51-4efd-4f06-826e-ca9c7407a61b tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:23.713761 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-bc1b2c51-4efd-4f06-826e-ca9c7407a61b tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:23.855952 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-bc1b2c51-4efd-4f06-826e-ca9c7407a61b tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:23.864421 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-bc1b2c51-4efd-4f06-826e-ca9c7407a61b tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/24a09aab-9508-4a08-a893-16eec8995ef8" status: 200 len: 1453 microversion: 2.1 time: 0.164970 Aug 24 07:48:23.864991 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 463/916] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:48:23 2022] GET /compute/v2.1/servers/24a09aab-9508-4a08-a893-16eec8995ef8 => generated 1453 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:48:23.884773 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-74c30f4f-9c50-4c2c-9c5c-e921873e9685 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:48:23.885381 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-74c30f4f-9c50-4c2c-9c5c-e921873e9685 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 24a09aab-9508-4a08-a893-16eec8995ef8] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:48:23.891873 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-74c30f4f-9c50-4c2c-9c5c-e921873e9685 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:23.892357 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-74c30f4f-9c50-4c2c-9c5c-e921873e9685 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:23.892786 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-74c30f4f-9c50-4c2c-9c5c-e921873e9685 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:23.893470 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-74c30f4f-9c50-4c2c-9c5c-e921873e9685 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:23.893919 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-74c30f4f-9c50-4c2c-9c5c-e921873e9685 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:23.894340 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-74c30f4f-9c50-4c2c-9c5c-e921873e9685 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:24.032817 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-74c30f4f-9c50-4c2c-9c5c-e921873e9685 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:24.040627 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-74c30f4f-9c50-4c2c-9c5c-e921873e9685 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/24a09aab-9508-4a08-a893-16eec8995ef8" status: 200 len: 1453 microversion: 2.1 time: 0.159621 Aug 24 07:48:24.041204 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 454/917] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:48:23 2022] GET /compute/v2.1/servers/24a09aab-9508-4a08-a893-16eec8995ef8 => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:48:24.583057 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-d44f64e0-a6a3-485c-84ff-f98f386eb9cd tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:48:24.584879 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-d44f64e0-a6a3-485c-84ff-f98f386eb9cd tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:48:24.592242 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d44f64e0-a6a3-485c-84ff-f98f386eb9cd tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:24.592242 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d44f64e0-a6a3-485c-84ff-f98f386eb9cd tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:24.593047 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d44f64e0-a6a3-485c-84ff-f98f386eb9cd tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:24.593850 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d44f64e0-a6a3-485c-84ff-f98f386eb9cd tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:24.594351 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d44f64e0-a6a3-485c-84ff-f98f386eb9cd tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:24.594808 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d44f64e0-a6a3-485c-84ff-f98f386eb9cd tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:24.661834 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-d44f64e0-a6a3-485c-84ff-f98f386eb9cd tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:24.670111 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-d44f64e0-a6a3-485c-84ff-f98f386eb9cd tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:24.672518 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-d44f64e0-a6a3-485c-84ff-f98f386eb9cd tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:24.673627 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-d44f64e0-a6a3-485c-84ff-f98f386eb9cd tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1340 microversion: 2.20 time: 0.095927 Aug 24 07:48:24.674190 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 464/918] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:48:24 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1340 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:48:25.697706 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-189b80b0-a82e-4cef-a562-6bef668faaf7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:48:25.698271 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-189b80b0-a82e-4cef-a562-6bef668faaf7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:48:25.705081 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-189b80b0-a82e-4cef-a562-6bef668faaf7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:25.705567 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-189b80b0-a82e-4cef-a562-6bef668faaf7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:25.706001 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-189b80b0-a82e-4cef-a562-6bef668faaf7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:25.706722 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-189b80b0-a82e-4cef-a562-6bef668faaf7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:25.707188 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-189b80b0-a82e-4cef-a562-6bef668faaf7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:25.707610 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-189b80b0-a82e-4cef-a562-6bef668faaf7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:25.952174 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-189b80b0-a82e-4cef-a562-6bef668faaf7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:25.960536 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-189b80b0-a82e-4cef-a562-6bef668faaf7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:25.962012 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-189b80b0-a82e-4cef-a562-6bef668faaf7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:25.963125 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-189b80b0-a82e-4cef-a562-6bef668faaf7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1340 microversion: 2.20 time: 0.269806 Aug 24 07:48:25.963661 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 455/919] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:48:25 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1340 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:48:26.681527 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [req-a514741d-af2d-4d68-86c7-1fb0e5d34fb5 req-5818ba67-7ba8-4755-b578-9a00aa8fc398 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24a09aab-9508-4a08-a893-16eec8995ef8", "tag": "c8813b7c-1c4b-464a-827b-33d862491a33"}]} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:48:26.697388 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-a514741d-af2d-4d68-86c7-1fb0e5d34fb5 req-5818ba67-7ba8-4755-b578-9a00aa8fc398 service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:26.698541 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-a514741d-af2d-4d68-86c7-1fb0e5d34fb5 req-5818ba67-7ba8-4755-b578-9a00aa8fc398 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:26.699155 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-a514741d-af2d-4d68-86c7-1fb0e5d34fb5 req-5818ba67-7ba8-4755-b578-9a00aa8fc398 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:26.713457 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.compute.server_external_events [req-a514741d-af2d-4d68-86c7-1fb0e5d34fb5 req-5818ba67-7ba8-4755-b578-9a00aa8fc398 service nova] Creating event network-changed:c8813b7c-1c4b-464a-827b-33d862491a33 for instance 24a09aab-9508-4a08-a893-16eec8995ef8 on hv-cinder-85427 Aug 24 07:48:26.719763 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [req-a514741d-af2d-4d68-86c7-1fb0e5d34fb5 req-5818ba67-7ba8-4755-b578-9a00aa8fc398 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043469 Aug 24 07:48:26.721212 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 465/920] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:48:26.986281 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-617dd830-364f-46cb-8482-ea4862813b29 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:48:26.987630 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-617dd830-364f-46cb-8482-ea4862813b29 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:48:26.998084 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-617dd830-364f-46cb-8482-ea4862813b29 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:26.999551 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-617dd830-364f-46cb-8482-ea4862813b29 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:27.000184 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-617dd830-364f-46cb-8482-ea4862813b29 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:27.001124 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-617dd830-364f-46cb-8482-ea4862813b29 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:27.001732 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-617dd830-364f-46cb-8482-ea4862813b29 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:27.003072 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-617dd830-364f-46cb-8482-ea4862813b29 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:27.284553 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-617dd830-364f-46cb-8482-ea4862813b29 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:27.294576 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-617dd830-364f-46cb-8482-ea4862813b29 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:27.297164 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-617dd830-364f-46cb-8482-ea4862813b29 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:27.298296 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-617dd830-364f-46cb-8482-ea4862813b29 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1407 microversion: 2.20 time: 0.316528 Aug 24 07:48:27.298871 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 456/921] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:48:26 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1407 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:48:28.322155 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-3c65c8b7-5c8b-41ca-8e20-13613f5556dc tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:48:28.322875 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-3c65c8b7-5c8b-41ca-8e20-13613f5556dc tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:48:28.330286 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3c65c8b7-5c8b-41ca-8e20-13613f5556dc tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:28.330812 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3c65c8b7-5c8b-41ca-8e20-13613f5556dc tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:28.331246 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3c65c8b7-5c8b-41ca-8e20-13613f5556dc tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:28.331927 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3c65c8b7-5c8b-41ca-8e20-13613f5556dc tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:28.332372 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3c65c8b7-5c8b-41ca-8e20-13613f5556dc tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:28.332788 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3c65c8b7-5c8b-41ca-8e20-13613f5556dc tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:28.348052 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:28.469874 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-3c65c8b7-5c8b-41ca-8e20-13613f5556dc tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:28.477856 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-3c65c8b7-5c8b-41ca-8e20-13613f5556dc tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:28.479400 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-3c65c8b7-5c8b-41ca-8e20-13613f5556dc tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:28.480505 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-3c65c8b7-5c8b-41ca-8e20-13613f5556dc tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1407 microversion: 2.20 time: 0.162616 Aug 24 07:48:28.481069 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 466/922] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:48:28 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:48:28.748461 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [req-b6715b42-2814-4173-892e-ded4b635a2bd req-87f056e2-72a1-4c87-a00e-da70ddd72538 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b6989bb-cd52-41ca-8e21-3e282a7c2445", "tag": "25bbb1a5-7b86-4b2e-9eea-4f302d25b92f"}]} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:48:28.758599 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-b6715b42-2814-4173-892e-ded4b635a2bd req-87f056e2-72a1-4c87-a00e-da70ddd72538 service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:28.759092 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-b6715b42-2814-4173-892e-ded4b635a2bd req-87f056e2-72a1-4c87-a00e-da70ddd72538 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:28.759510 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-b6715b42-2814-4173-892e-ded4b635a2bd req-87f056e2-72a1-4c87-a00e-da70ddd72538 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:28.770747 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.compute.server_external_events [req-b6715b42-2814-4173-892e-ded4b635a2bd req-87f056e2-72a1-4c87-a00e-da70ddd72538 service nova] Creating event network-changed:25bbb1a5-7b86-4b2e-9eea-4f302d25b92f for instance 6b6989bb-cd52-41ca-8e21-3e282a7c2445 on hv-cinder-85427 Aug 24 07:48:28.775827 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [req-b6715b42-2814-4173-892e-ded4b635a2bd req-87f056e2-72a1-4c87-a00e-da70ddd72538 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031074 Aug 24 07:48:28.776383 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 457/923] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:48:29.503798 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-b90e776e-d90e-43da-af7b-c40d47203577 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:48:29.504452 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-b90e776e-d90e-43da-af7b-c40d47203577 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:48:29.510804 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b90e776e-d90e-43da-af7b-c40d47203577 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:29.511291 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b90e776e-d90e-43da-af7b-c40d47203577 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:29.511729 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b90e776e-d90e-43da-af7b-c40d47203577 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:29.512423 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b90e776e-d90e-43da-af7b-c40d47203577 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:29.512878 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b90e776e-d90e-43da-af7b-c40d47203577 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:29.513299 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b90e776e-d90e-43da-af7b-c40d47203577 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:29.644423 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-b90e776e-d90e-43da-af7b-c40d47203577 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:29.653773 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-b90e776e-d90e-43da-af7b-c40d47203577 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:29.655933 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-b90e776e-d90e-43da-af7b-c40d47203577 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:29.657038 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-b90e776e-d90e-43da-af7b-c40d47203577 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1407 microversion: 2.20 time: 0.157215 Aug 24 07:48:29.657588 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 467/924] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:48:29 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:48:30.679224 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-338951b6-590a-4053-8976-a62d7bc51c35 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:48:30.679910 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-338951b6-590a-4053-8976-a62d7bc51c35 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:48:30.686031 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-338951b6-590a-4053-8976-a62d7bc51c35 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:30.686509 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-338951b6-590a-4053-8976-a62d7bc51c35 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:30.686966 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-338951b6-590a-4053-8976-a62d7bc51c35 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:30.687651 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-338951b6-590a-4053-8976-a62d7bc51c35 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:30.688098 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-338951b6-590a-4053-8976-a62d7bc51c35 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:30.688519 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-338951b6-590a-4053-8976-a62d7bc51c35 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:30.821505 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-338951b6-590a-4053-8976-a62d7bc51c35 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:30.830288 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-338951b6-590a-4053-8976-a62d7bc51c35 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:30.831820 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-338951b6-590a-4053-8976-a62d7bc51c35 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:30.832921 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-338951b6-590a-4053-8976-a62d7bc51c35 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1407 microversion: 2.20 time: 0.158124 Aug 24 07:48:30.833468 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 458/925] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:48:30 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:48:31.454640 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [req-0c5b1766-8b2d-48b4-9d31-9bb5e30c88d7 req-9095bd71-2527-4859-b682-9b9f61d6bc80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b6989bb-cd52-41ca-8e21-3e282a7c2445", "name": "network-vif-plugged", "status": "completed", "tag": "25bbb1a5-7b86-4b2e-9eea-4f302d25b92f"}]} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:48:31.464674 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-0c5b1766-8b2d-48b4-9d31-9bb5e30c88d7 req-9095bd71-2527-4859-b682-9b9f61d6bc80 service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:31.465226 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-0c5b1766-8b2d-48b4-9d31-9bb5e30c88d7 req-9095bd71-2527-4859-b682-9b9f61d6bc80 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:31.465655 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-0c5b1766-8b2d-48b4-9d31-9bb5e30c88d7 req-9095bd71-2527-4859-b682-9b9f61d6bc80 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:31.476812 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.compute.server_external_events [req-0c5b1766-8b2d-48b4-9d31-9bb5e30c88d7 req-9095bd71-2527-4859-b682-9b9f61d6bc80 service nova] Creating event network-vif-plugged:25bbb1a5-7b86-4b2e-9eea-4f302d25b92f for instance 6b6989bb-cd52-41ca-8e21-3e282a7c2445 on hv-cinder-85427 Aug 24 07:48:31.481396 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [req-0c5b1766-8b2d-48b4-9d31-9bb5e30c88d7 req-9095bd71-2527-4859-b682-9b9f61d6bc80 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030433 Aug 24 07:48:31.481979 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 468/926] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:48:31.855037 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-16993cfc-11ee-4c61-b454-432810816cbb tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:48:31.855644 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-16993cfc-11ee-4c61-b454-432810816cbb tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:48:31.862754 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-16993cfc-11ee-4c61-b454-432810816cbb tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:31.863233 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-16993cfc-11ee-4c61-b454-432810816cbb tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:31.863665 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-16993cfc-11ee-4c61-b454-432810816cbb tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:31.864351 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-16993cfc-11ee-4c61-b454-432810816cbb tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:31.864801 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-16993cfc-11ee-4c61-b454-432810816cbb tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:31.865220 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-16993cfc-11ee-4c61-b454-432810816cbb tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:31.990413 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-16993cfc-11ee-4c61-b454-432810816cbb tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:31.998421 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-16993cfc-11ee-4c61-b454-432810816cbb tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:31.999946 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-16993cfc-11ee-4c61-b454-432810816cbb tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:32.001039 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-16993cfc-11ee-4c61-b454-432810816cbb tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1407 microversion: 2.20 time: 0.150038 Aug 24 07:48:32.001591 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 459/927] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:48:31 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:48:33.024363 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-649978fa-50c3-4bb5-9e00-119bfba8e392 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:48:33.025066 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-649978fa-50c3-4bb5-9e00-119bfba8e392 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:48:33.031675 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-649978fa-50c3-4bb5-9e00-119bfba8e392 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:33.032154 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-649978fa-50c3-4bb5-9e00-119bfba8e392 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:33.032583 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-649978fa-50c3-4bb5-9e00-119bfba8e392 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:33.033264 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-649978fa-50c3-4bb5-9e00-119bfba8e392 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:33.033712 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-649978fa-50c3-4bb5-9e00-119bfba8e392 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:33.034130 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-649978fa-50c3-4bb5-9e00-119bfba8e392 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:33.164229 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-649978fa-50c3-4bb5-9e00-119bfba8e392 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:33.173201 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-649978fa-50c3-4bb5-9e00-119bfba8e392 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:33.175010 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-649978fa-50c3-4bb5-9e00-119bfba8e392 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:33.176103 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-649978fa-50c3-4bb5-9e00-119bfba8e392 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1407 microversion: 2.20 time: 0.156570 Aug 24 07:48:33.176640 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 469/928] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:48:33 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:48:34.198231 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-bcf0c51e-12ee-4aad-bfe6-2a81451a4bb9 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:48:34.198873 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-bcf0c51e-12ee-4aad-bfe6-2a81451a4bb9 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:48:34.201269 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell0:SELECT=2 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:34.206986 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bcf0c51e-12ee-4aad-bfe6-2a81451a4bb9 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:34.207464 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bcf0c51e-12ee-4aad-bfe6-2a81451a4bb9 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:34.207899 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bcf0c51e-12ee-4aad-bfe6-2a81451a4bb9 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:34.208583 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bcf0c51e-12ee-4aad-bfe6-2a81451a4bb9 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:34.209037 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bcf0c51e-12ee-4aad-bfe6-2a81451a4bb9 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:34.209456 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bcf0c51e-12ee-4aad-bfe6-2a81451a4bb9 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:34.338099 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-bcf0c51e-12ee-4aad-bfe6-2a81451a4bb9 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:34.340290 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell1:SELECT=100 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:34.347648 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-bcf0c51e-12ee-4aad-bfe6-2a81451a4bb9 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:34.349152 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-bcf0c51e-12ee-4aad-bfe6-2a81451a4bb9 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:48:34.350310 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-bcf0c51e-12ee-4aad-bfe6-2a81451a4bb9 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1598 microversion: 2.20 time: 0.155962 Aug 24 07:48:34.351019 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 460/929] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:48:34 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1598 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:48:34.372142 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-6030aa49-e342-4945-a9cf-a2118afdfb7d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:48:34.372665 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-6030aa49-e342-4945-a9cf-a2118afdfb7d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:48:34.375260 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell0:SELECT=2 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:34.375902 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell0:SELECT=10 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:48:34.382266 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6030aa49-e342-4945-a9cf-a2118afdfb7d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:34.382823 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6030aa49-e342-4945-a9cf-a2118afdfb7d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:34.383258 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6030aa49-e342-4945-a9cf-a2118afdfb7d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:34.383938 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6030aa49-e342-4945-a9cf-a2118afdfb7d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:34.384383 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6030aa49-e342-4945-a9cf-a2118afdfb7d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:34.384800 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6030aa49-e342-4945-a9cf-a2118afdfb7d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:34.458858 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-6030aa49-e342-4945-a9cf-a2118afdfb7d tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.090472 Aug 24 07:48:34.459439 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 470/930] 10.222.0.42 () {60 vars in 1316 bytes} [Wed Aug 24 07:48:34 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 07:48:35.351886 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [req-4b5e5d85-2568-4054-81e9-f8fbc6219e66 req-8257bd23-1ab8-4929-b590-e332b6b9c2cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b6989bb-cd52-41ca-8e21-3e282a7c2445", "tag": "25bbb1a5-7b86-4b2e-9eea-4f302d25b92f"}]} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:48:35.361728 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-4b5e5d85-2568-4054-81e9-f8fbc6219e66 req-8257bd23-1ab8-4929-b590-e332b6b9c2cf service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:48:35.362286 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-4b5e5d85-2568-4054-81e9-f8fbc6219e66 req-8257bd23-1ab8-4929-b590-e332b6b9c2cf service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:48:35.362825 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-4b5e5d85-2568-4054-81e9-f8fbc6219e66 req-8257bd23-1ab8-4929-b590-e332b6b9c2cf service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:48:35.374244 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.compute.server_external_events [req-4b5e5d85-2568-4054-81e9-f8fbc6219e66 req-8257bd23-1ab8-4929-b590-e332b6b9c2cf service nova] Creating event network-changed:25bbb1a5-7b86-4b2e-9eea-4f302d25b92f for instance 6b6989bb-cd52-41ca-8e21-3e282a7c2445 on hv-cinder-85427 Aug 24 07:48:35.379218 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [req-4b5e5d85-2568-4054-81e9-f8fbc6219e66 req-8257bd23-1ab8-4929-b590-e332b6b9c2cf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031053 Aug 24 07:48:35.379794 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 461/931] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:49:11.138711 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:11.139723 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell1:SELECT=21 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:11.144403 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-b6dad7f7-5787-4d99-b3de-b91b1f2e3d83 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:11.144892 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-b6dad7f7-5787-4d99-b3de-b91b1f2e3d83 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:49:11.152834 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b6dad7f7-5787-4d99-b3de-b91b1f2e3d83 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:11.153307 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b6dad7f7-5787-4d99-b3de-b91b1f2e3d83 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:11.153737 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b6dad7f7-5787-4d99-b3de-b91b1f2e3d83 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:11.154416 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b6dad7f7-5787-4d99-b3de-b91b1f2e3d83 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:11.154894 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b6dad7f7-5787-4d99-b3de-b91b1f2e3d83 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:11.155315 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b6dad7f7-5787-4d99-b3de-b91b1f2e3d83 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:11.178840 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-b6dad7f7-5787-4d99-b3de-b91b1f2e3d83 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445/ips" status: 200 len: 150 microversion: 2.20 time: 0.041867 Aug 24 07:49:11.179391 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 471/932] 10.222.0.42 () {60 vars in 1289 bytes} [Wed Aug 24 07:49:11 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 07:49:12.965732 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:12.966476 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell1:SELECT=3 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:12.971062 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-01a68005-7d76-4b6e-9c36-f785384c00bb tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:49:12.971674 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-01a68005-7d76-4b6e-9c36-f785384c00bb tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:49:12.979317 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-01a68005-7d76-4b6e-9c36-f785384c00bb tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:12.979787 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-01a68005-7d76-4b6e-9c36-f785384c00bb tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:12.980209 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-01a68005-7d76-4b6e-9c36-f785384c00bb tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:12.980887 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-01a68005-7d76-4b6e-9c36-f785384c00bb tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:12.981333 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-01a68005-7d76-4b6e-9c36-f785384c00bb tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:12.981748 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-01a68005-7d76-4b6e-9c36-f785384c00bb tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:13.003846 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.objects.instance [None req-01a68005-7d76-4b6e-9c36-f785384c00bb tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lazy-loading 'flavor' on Instance uuid 6b6989bb-cd52-41ca-8e21-3e282a7c2445 {{(pid=127113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:49:13.175759 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-01a68005-7d76-4b6e-9c36-f785384c00bb tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "POST /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445/action" status: 202 len: 0 microversion: 2.20 time: 0.211367 Aug 24 07:49:13.176460 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 462/933] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 24 07:49:12 2022] POST /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 07:49:13.185732 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-831dd7f5-6484-452c-b03f-3d4e201e406c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:13.186342 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-831dd7f5-6484-452c-b03f-3d4e201e406c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:49:13.194042 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-831dd7f5-6484-452c-b03f-3d4e201e406c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:13.194547 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-831dd7f5-6484-452c-b03f-3d4e201e406c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:13.195193 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-831dd7f5-6484-452c-b03f-3d4e201e406c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:13.195899 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-831dd7f5-6484-452c-b03f-3d4e201e406c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:13.197174 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-831dd7f5-6484-452c-b03f-3d4e201e406c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:13.197605 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-831dd7f5-6484-452c-b03f-3d4e201e406c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:13.330419 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-831dd7f5-6484-452c-b03f-3d4e201e406c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:13.339559 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-831dd7f5-6484-452c-b03f-3d4e201e406c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:13.341056 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-831dd7f5-6484-452c-b03f-3d4e201e406c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:13.342223 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-831dd7f5-6484-452c-b03f-3d4e201e406c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1722 microversion: 2.20 time: 0.160705 Aug 24 07:49:13.342789 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 472/934] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:49:13 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:49:14.365943 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-622684fd-7796-470e-a549-6bcc19a63a96 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:14.366632 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-622684fd-7796-470e-a549-6bcc19a63a96 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:49:14.373542 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-622684fd-7796-470e-a549-6bcc19a63a96 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:14.374019 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-622684fd-7796-470e-a549-6bcc19a63a96 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:14.374965 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-622684fd-7796-470e-a549-6bcc19a63a96 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:14.375666 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-622684fd-7796-470e-a549-6bcc19a63a96 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:14.376117 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-622684fd-7796-470e-a549-6bcc19a63a96 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:14.376537 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-622684fd-7796-470e-a549-6bcc19a63a96 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:14.502843 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-622684fd-7796-470e-a549-6bcc19a63a96 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:14.510883 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-622684fd-7796-470e-a549-6bcc19a63a96 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:14.512379 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-622684fd-7796-470e-a549-6bcc19a63a96 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:14.513529 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-622684fd-7796-470e-a549-6bcc19a63a96 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1722 microversion: 2.20 time: 0.152444 Aug 24 07:49:14.514074 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 463/935] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:49:14 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:49:15.536941 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-03097012-7cf7-4cbe-85e4-3baa607f9fee tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:15.537535 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-03097012-7cf7-4cbe-85e4-3baa607f9fee tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:49:15.544174 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-03097012-7cf7-4cbe-85e4-3baa607f9fee tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:15.544644 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-03097012-7cf7-4cbe-85e4-3baa607f9fee tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:15.545073 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-03097012-7cf7-4cbe-85e4-3baa607f9fee tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:15.545748 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-03097012-7cf7-4cbe-85e4-3baa607f9fee tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:15.546195 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-03097012-7cf7-4cbe-85e4-3baa607f9fee tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:15.546938 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-03097012-7cf7-4cbe-85e4-3baa607f9fee tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:15.671442 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-03097012-7cf7-4cbe-85e4-3baa607f9fee tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:15.679588 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-03097012-7cf7-4cbe-85e4-3baa607f9fee tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:15.681121 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-03097012-7cf7-4cbe-85e4-3baa607f9fee tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:15.682259 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-03097012-7cf7-4cbe-85e4-3baa607f9fee tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1722 microversion: 2.20 time: 0.149206 Aug 24 07:49:15.682818 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 473/936] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:49:15 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 07:49:16.704659 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-645c8f03-d825-4c19-b4a1-754611cbd007 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:16.705288 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-645c8f03-d825-4c19-b4a1-754611cbd007 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:49:16.711641 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-645c8f03-d825-4c19-b4a1-754611cbd007 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:16.712112 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-645c8f03-d825-4c19-b4a1-754611cbd007 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:16.712536 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-645c8f03-d825-4c19-b4a1-754611cbd007 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:16.713223 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-645c8f03-d825-4c19-b4a1-754611cbd007 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:16.713645 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-645c8f03-d825-4c19-b4a1-754611cbd007 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:16.714056 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-645c8f03-d825-4c19-b4a1-754611cbd007 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:16.843935 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-645c8f03-d825-4c19-b4a1-754611cbd007 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:16.851974 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-645c8f03-d825-4c19-b4a1-754611cbd007 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:16.853469 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-645c8f03-d825-4c19-b4a1-754611cbd007 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:16.854617 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-645c8f03-d825-4c19-b4a1-754611cbd007 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1722 microversion: 2.20 time: 0.153901 Aug 24 07:49:16.855195 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 464/937] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:49:16 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:49:17.877619 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-8ed91029-70e5-4869-9d79-c06e8e9de207 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:17.878241 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-8ed91029-70e5-4869-9d79-c06e8e9de207 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:49:17.884638 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8ed91029-70e5-4869-9d79-c06e8e9de207 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:17.885113 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8ed91029-70e5-4869-9d79-c06e8e9de207 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:17.885532 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8ed91029-70e5-4869-9d79-c06e8e9de207 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:17.886208 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8ed91029-70e5-4869-9d79-c06e8e9de207 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:17.886652 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8ed91029-70e5-4869-9d79-c06e8e9de207 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:17.887096 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8ed91029-70e5-4869-9d79-c06e8e9de207 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:18.018380 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-8ed91029-70e5-4869-9d79-c06e8e9de207 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:18.026315 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-8ed91029-70e5-4869-9d79-c06e8e9de207 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:18.027826 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-8ed91029-70e5-4869-9d79-c06e8e9de207 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:18.028961 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-8ed91029-70e5-4869-9d79-c06e8e9de207 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1722 microversion: 2.20 time: 0.155502 Aug 24 07:49:18.029501 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 474/938] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:49:17 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:49:19.051727 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-ccec27f7-569a-4971-aa21-6797765e8203 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:19.052315 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-ccec27f7-569a-4971-aa21-6797765e8203 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:49:19.058615 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ccec27f7-569a-4971-aa21-6797765e8203 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:19.059121 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ccec27f7-569a-4971-aa21-6797765e8203 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:19.059549 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ccec27f7-569a-4971-aa21-6797765e8203 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:19.060230 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ccec27f7-569a-4971-aa21-6797765e8203 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:19.060714 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ccec27f7-569a-4971-aa21-6797765e8203 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:19.061138 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ccec27f7-569a-4971-aa21-6797765e8203 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:19.190732 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-ccec27f7-569a-4971-aa21-6797765e8203 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:19.198675 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-ccec27f7-569a-4971-aa21-6797765e8203 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:19.200196 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-ccec27f7-569a-4971-aa21-6797765e8203 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:19.201355 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-ccec27f7-569a-4971-aa21-6797765e8203 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1722 microversion: 2.20 time: 0.153521 Aug 24 07:49:19.201910 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 465/939] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:49:19 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:49:20.227301 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-0c54faca-8c9b-43a1-9fb4-823a75d7cdd3 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:20.227902 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-0c54faca-8c9b-43a1-9fb4-823a75d7cdd3 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:49:20.234266 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0c54faca-8c9b-43a1-9fb4-823a75d7cdd3 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:20.234779 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0c54faca-8c9b-43a1-9fb4-823a75d7cdd3 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:20.235215 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0c54faca-8c9b-43a1-9fb4-823a75d7cdd3 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:20.235900 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0c54faca-8c9b-43a1-9fb4-823a75d7cdd3 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:20.236357 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0c54faca-8c9b-43a1-9fb4-823a75d7cdd3 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:20.236777 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0c54faca-8c9b-43a1-9fb4-823a75d7cdd3 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:20.362078 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-0c54faca-8c9b-43a1-9fb4-823a75d7cdd3 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:20.371973 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-0c54faca-8c9b-43a1-9fb4-823a75d7cdd3 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:20.375052 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-0c54faca-8c9b-43a1-9fb4-823a75d7cdd3 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:20.376233 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-0c54faca-8c9b-43a1-9fb4-823a75d7cdd3 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1722 microversion: 2.20 time: 0.152886 Aug 24 07:49:20.376792 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 475/940] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:49:20 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:49:21.398568 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-ec03525c-7608-4bc3-9d99-22d9d4f932c2 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:21.399204 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-ec03525c-7608-4bc3-9d99-22d9d4f932c2 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:49:21.405571 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ec03525c-7608-4bc3-9d99-22d9d4f932c2 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:21.406066 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ec03525c-7608-4bc3-9d99-22d9d4f932c2 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:21.406491 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ec03525c-7608-4bc3-9d99-22d9d4f932c2 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:21.407188 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ec03525c-7608-4bc3-9d99-22d9d4f932c2 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:21.407634 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ec03525c-7608-4bc3-9d99-22d9d4f932c2 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:21.408050 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ec03525c-7608-4bc3-9d99-22d9d4f932c2 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:21.539285 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-ec03525c-7608-4bc3-9d99-22d9d4f932c2 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:21.548049 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-ec03525c-7608-4bc3-9d99-22d9d4f932c2 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:21.549579 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-ec03525c-7608-4bc3-9d99-22d9d4f932c2 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:21.551058 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-ec03525c-7608-4bc3-9d99-22d9d4f932c2 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1722 microversion: 2.20 time: 0.156121 Aug 24 07:49:21.551614 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 466/941] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:49:21 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:49:22.573528 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-1cd87e32-316a-46d7-9fce-f3ef52227d1a tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:22.574153 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-1cd87e32-316a-46d7-9fce-f3ef52227d1a tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:49:22.581476 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1cd87e32-316a-46d7-9fce-f3ef52227d1a tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:22.581953 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1cd87e32-316a-46d7-9fce-f3ef52227d1a tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:22.582377 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1cd87e32-316a-46d7-9fce-f3ef52227d1a tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:22.583148 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1cd87e32-316a-46d7-9fce-f3ef52227d1a tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:22.583599 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1cd87e32-316a-46d7-9fce-f3ef52227d1a tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:22.584016 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1cd87e32-316a-46d7-9fce-f3ef52227d1a tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:22.707467 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-1cd87e32-316a-46d7-9fce-f3ef52227d1a tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:22.715451 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-1cd87e32-316a-46d7-9fce-f3ef52227d1a tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:22.716958 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-1cd87e32-316a-46d7-9fce-f3ef52227d1a tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:22.718119 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-1cd87e32-316a-46d7-9fce-f3ef52227d1a tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1722 microversion: 2.20 time: 0.148670 Aug 24 07:49:22.719211 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 476/942] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:49:22 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:49:23.740964 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-1a61f939-5e23-4fa5-a28a-bc627ef34476 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:23.741548 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-1a61f939-5e23-4fa5-a28a-bc627ef34476 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:49:23.748244 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1a61f939-5e23-4fa5-a28a-bc627ef34476 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:23.748738 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1a61f939-5e23-4fa5-a28a-bc627ef34476 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:23.749151 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1a61f939-5e23-4fa5-a28a-bc627ef34476 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:23.750417 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1a61f939-5e23-4fa5-a28a-bc627ef34476 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:23.750898 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1a61f939-5e23-4fa5-a28a-bc627ef34476 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:23.751325 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1a61f939-5e23-4fa5-a28a-bc627ef34476 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:23.885388 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-1a61f939-5e23-4fa5-a28a-bc627ef34476 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:23.895097 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-1a61f939-5e23-4fa5-a28a-bc627ef34476 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:23.896595 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-1a61f939-5e23-4fa5-a28a-bc627ef34476 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:23.897743 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-1a61f939-5e23-4fa5-a28a-bc627ef34476 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1722 microversion: 2.20 time: 0.160726 Aug 24 07:49:23.898294 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 467/943] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:49:23 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:49:24.195065 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-26052359-1288-4bf9-8540-ff2191c5de29 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:24.200609 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [req-bf762bc3-a64b-4a11-a473-c0ed0348d55c req-29d68a36-6d9b-459c-8d14-370c4a975b98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b258660f-e099-4e37-ab2a-4049ad88a647", "tag": "70dd01d5-20d6-47f1-8ddc-7d15de6b2627"}]} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:49:24.203403 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-26052359-1288-4bf9-8540-ff2191c5de29 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:49:24.210589 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-26052359-1288-4bf9-8540-ff2191c5de29 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:24.211122 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-26052359-1288-4bf9-8540-ff2191c5de29 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:24.211561 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-26052359-1288-4bf9-8540-ff2191c5de29 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:24.213003 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-26052359-1288-4bf9-8540-ff2191c5de29 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:24.213517 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-26052359-1288-4bf9-8540-ff2191c5de29 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:24.213953 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-26052359-1288-4bf9-8540-ff2191c5de29 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:24.214060 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-bf762bc3-a64b-4a11-a473-c0ed0348d55c req-29d68a36-6d9b-459c-8d14-370c4a975b98 service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:24.214531 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-bf762bc3-a64b-4a11-a473-c0ed0348d55c req-29d68a36-6d9b-459c-8d14-370c4a975b98 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:24.214994 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-bf762bc3-a64b-4a11-a473-c0ed0348d55c req-29d68a36-6d9b-459c-8d14-370c4a975b98 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:24.226857 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.compute.server_external_events [req-bf762bc3-a64b-4a11-a473-c0ed0348d55c req-29d68a36-6d9b-459c-8d14-370c4a975b98 service nova] Creating event network-changed:70dd01d5-20d6-47f1-8ddc-7d15de6b2627 for instance b258660f-e099-4e37-ab2a-4049ad88a647 on hv-cinder-85427 Aug 24 07:49:24.232555 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [req-bf762bc3-a64b-4a11-a473-c0ed0348d55c req-29d68a36-6d9b-459c-8d14-370c4a975b98 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035499 Aug 24 07:49:24.233381 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 468/944] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:49:24.253970 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-26052359-1288-4bf9-8540-ff2191c5de29 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Going to try to terminate instance {{(pid=127114) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 07:49:24.376790 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-26052359-1288-4bf9-8540-ff2191c5de29 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 204 len: 0 microversion: 2.1 time: 0.185708 Aug 24 07:49:24.377702 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 477/945] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 24 07:49:24 2022] DELETE /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 07:49:24.386667 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-9292495b-65d6-4e84-b5e9-3a33fb202467 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:24.387807 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-9292495b-65d6-4e84-b5e9-3a33fb202467 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:49:24.399003 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9292495b-65d6-4e84-b5e9-3a33fb202467 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:24.399719 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9292495b-65d6-4e84-b5e9-3a33fb202467 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:24.400217 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9292495b-65d6-4e84-b5e9-3a33fb202467 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:24.401139 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9292495b-65d6-4e84-b5e9-3a33fb202467 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:24.401810 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9292495b-65d6-4e84-b5e9-3a33fb202467 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:24.402434 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9292495b-65d6-4e84-b5e9-3a33fb202467 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:24.588646 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-9292495b-65d6-4e84-b5e9-3a33fb202467 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:24.596508 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-9292495b-65d6-4e84-b5e9-3a33fb202467 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1566 microversion: 2.1 time: 0.214369 Aug 24 07:49:24.600632 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 469/946] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:49:24 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1566 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:49:24.921278 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-442a5114-466b-421e-a480-d4846d84d4e7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:24.922750 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-442a5114-466b-421e-a480-d4846d84d4e7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:49:24.928949 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-442a5114-466b-421e-a480-d4846d84d4e7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:24.929459 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-442a5114-466b-421e-a480-d4846d84d4e7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:24.929987 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-442a5114-466b-421e-a480-d4846d84d4e7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:24.930724 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-442a5114-466b-421e-a480-d4846d84d4e7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:24.931170 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-442a5114-466b-421e-a480-d4846d84d4e7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:24.931587 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-442a5114-466b-421e-a480-d4846d84d4e7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:25.077007 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-442a5114-466b-421e-a480-d4846d84d4e7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:25.086071 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-442a5114-466b-421e-a480-d4846d84d4e7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:25.087613 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-442a5114-466b-421e-a480-d4846d84d4e7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:25.088777 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-442a5114-466b-421e-a480-d4846d84d4e7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1722 microversion: 2.20 time: 0.171921 Aug 24 07:49:25.089460 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 478/947] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:49:24 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:49:25.618061 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-ac91a8cb-3c4a-4476-b80c-4a7976cfbce1 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:25.618664 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-ac91a8cb-3c4a-4476-b80c-4a7976cfbce1 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:49:25.625514 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ac91a8cb-3c4a-4476-b80c-4a7976cfbce1 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:25.625981 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ac91a8cb-3c4a-4476-b80c-4a7976cfbce1 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:25.626405 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ac91a8cb-3c4a-4476-b80c-4a7976cfbce1 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:25.627113 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ac91a8cb-3c4a-4476-b80c-4a7976cfbce1 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:25.627556 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ac91a8cb-3c4a-4476-b80c-4a7976cfbce1 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:25.627973 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ac91a8cb-3c4a-4476-b80c-4a7976cfbce1 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:25.790288 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-ac91a8cb-3c4a-4476-b80c-4a7976cfbce1 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:25.798688 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-ac91a8cb-3c4a-4476-b80c-4a7976cfbce1 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1566 microversion: 2.1 time: 0.184562 Aug 24 07:49:25.799502 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 470/948] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:49:25 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1566 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:49:26.111913 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-9f274d81-b337-4e36-88ec-a261480b05e7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:26.112645 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-9f274d81-b337-4e36-88ec-a261480b05e7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:49:26.120310 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9f274d81-b337-4e36-88ec-a261480b05e7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:26.120909 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9f274d81-b337-4e36-88ec-a261480b05e7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:26.121350 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9f274d81-b337-4e36-88ec-a261480b05e7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:26.122080 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9f274d81-b337-4e36-88ec-a261480b05e7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:26.122570 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9f274d81-b337-4e36-88ec-a261480b05e7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:26.123053 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9f274d81-b337-4e36-88ec-a261480b05e7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:26.351706 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-9f274d81-b337-4e36-88ec-a261480b05e7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:26.359742 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-9f274d81-b337-4e36-88ec-a261480b05e7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:26.361240 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-9f274d81-b337-4e36-88ec-a261480b05e7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:26.362519 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-9f274d81-b337-4e36-88ec-a261480b05e7 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1722 microversion: 2.20 time: 0.254416 Aug 24 07:49:26.363061 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 479/949] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:49:26 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1722 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:49:26.655579 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [req-bbdc9c41-b1d1-446b-9e05-513e51d5dc64 req-8ac89f8b-071c-434d-8aaa-8bd6d012c915 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b258660f-e099-4e37-ab2a-4049ad88a647", "name": "network-vif-deleted", "tag": "70dd01d5-20d6-47f1-8ddc-7d15de6b2627"}]} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:49:26.665495 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-bbdc9c41-b1d1-446b-9e05-513e51d5dc64 req-8ac89f8b-071c-434d-8aaa-8bd6d012c915 service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:26.665978 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-bbdc9c41-b1d1-446b-9e05-513e51d5dc64 req-8ac89f8b-071c-434d-8aaa-8bd6d012c915 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:26.666403 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-bbdc9c41-b1d1-446b-9e05-513e51d5dc64 req-8ac89f8b-071c-434d-8aaa-8bd6d012c915 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:26.678476 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.compute.server_external_events [req-bbdc9c41-b1d1-446b-9e05-513e51d5dc64 req-8ac89f8b-071c-434d-8aaa-8bd6d012c915 service nova] Creating event network-vif-deleted:70dd01d5-20d6-47f1-8ddc-7d15de6b2627 for instance b258660f-e099-4e37-ab2a-4049ad88a647 on hv-cinder-85427 Aug 24 07:49:26.683546 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [req-bbdc9c41-b1d1-446b-9e05-513e51d5dc64 req-8ac89f8b-071c-434d-8aaa-8bd6d012c915 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031626 Aug 24 07:49:26.684193 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 471/950] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:49:26.820166 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-e4c26a6a-3690-4cb6-90e4-e22d219ea526 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:26.820786 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-e4c26a6a-3690-4cb6-90e4-e22d219ea526 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:49:26.826973 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e4c26a6a-3690-4cb6-90e4-e22d219ea526 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:26.827454 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e4c26a6a-3690-4cb6-90e4-e22d219ea526 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:26.827881 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e4c26a6a-3690-4cb6-90e4-e22d219ea526 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:26.828566 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e4c26a6a-3690-4cb6-90e4-e22d219ea526 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:26.829012 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e4c26a6a-3690-4cb6-90e4-e22d219ea526 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:26.829435 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e4c26a6a-3690-4cb6-90e4-e22d219ea526 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:26.893786 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-e4c26a6a-3690-4cb6-90e4-e22d219ea526 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75bdaeec19be45388613c7e22aa009db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75359bcb24b4beb8de99809d2bef6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:26.901608 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-e4c26a6a-3690-4cb6-90e4-e22d219ea526 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 200 len: 1218 microversion: 2.1 time: 0.085449 Aug 24 07:49:26.902170 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 480/951] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:49:26 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:49:27.386312 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-757b6d5a-6ab5-40d5-ad6c-ced08bca6bff tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:27.387044 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-757b6d5a-6ab5-40d5-ad6c-ced08bca6bff tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:49:27.393572 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-757b6d5a-6ab5-40d5-ad6c-ced08bca6bff tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:27.394045 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-757b6d5a-6ab5-40d5-ad6c-ced08bca6bff tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:27.394469 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-757b6d5a-6ab5-40d5-ad6c-ced08bca6bff tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:27.395205 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-757b6d5a-6ab5-40d5-ad6c-ced08bca6bff tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:27.395652 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-757b6d5a-6ab5-40d5-ad6c-ced08bca6bff tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:27.396071 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-757b6d5a-6ab5-40d5-ad6c-ced08bca6bff tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:27.523701 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-757b6d5a-6ab5-40d5-ad6c-ced08bca6bff tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:27.532612 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-757b6d5a-6ab5-40d5-ad6c-ced08bca6bff tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:27.534176 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-757b6d5a-6ab5-40d5-ad6c-ced08bca6bff tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:27.535451 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-757b6d5a-6ab5-40d5-ad6c-ced08bca6bff tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1722 microversion: 2.20 time: 0.153399 Aug 24 07:49:27.536031 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 472/952] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:49:27 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:49:27.923029 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-03eb63e3-0641-48d8-a76e-b2e7d07e384f tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:27.923641 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-03eb63e3-0641-48d8-a76e-b2e7d07e384f tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] [instance: b258660f-e099-4e37-ab2a-4049ad88a647] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:49:27.930305 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-03eb63e3-0641-48d8-a76e-b2e7d07e384f tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:27.930826 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-03eb63e3-0641-48d8-a76e-b2e7d07e384f tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:27.931375 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-03eb63e3-0641-48d8-a76e-b2e7d07e384f tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:27.932073 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-03eb63e3-0641-48d8-a76e-b2e7d07e384f tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:27.932523 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-03eb63e3-0641-48d8-a76e-b2e7d07e384f tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:27.932942 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-03eb63e3-0641-48d8-a76e-b2e7d07e384f tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:27.948870 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.wsgi [None req-03eb63e3-0641-48d8-a76e-b2e7d07e384f tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] HTTP exception thrown: Instance b258660f-e099-4e37-ab2a-4049ad88a647 could not be found. Aug 24 07:49:27.950527 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-03eb63e3-0641-48d8-a76e-b2e7d07e384f tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Request method failure captured: Aug 24 07:49:27.950527 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: request: GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 HTTP/1.1 Aug 24 07:49:27.950527 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept: application/json Aug 24 07:49:27.950527 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept-Encoding: identity Aug 24 07:49:27.950527 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Connection: close Aug 24 07:49:27.950527 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Length: 0 Aug 24 07:49:27.950527 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Type: application/json Aug 24 07:49:27.950527 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Host: 10.222.0.42 Aug 24 07:49:27.950527 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Openstack-System-Scope: None Aug 24 07:49:27.950527 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: User-Agent: python-urllib3/1.26.11 Aug 24 07:49:27.950527 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Auth-Token: gAAAAABjBdbmvHO2har3LvqeVQ8RoB_-ORxckqVSBLoKNSDy1d-zeQb3ZBsr-_ZHDku6aK6DeZTcry9pXQ5Qc3cLC5qWh0Sf5zpPhU7E8GEmdnZ3UQQH7Uz56SxA7l9_7tDw65X8fIFyhr3aV6dXtlUg3KPax1DRlWUmiYdIQ-Sepzq8-IR7TGw Aug 24 07:49:27.950527 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Id: None Aug 24 07:49:27.950527 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Name: None Aug 24 07:49:27.950527 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Identity-Status: Confirmed Aug 24 07:49:27.950527 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Is-Admin-Project: True Aug 24 07:49:27.950527 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Id: default Aug 24 07:49:27.950527 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Name: Default Aug 24 07:49:27.950527 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Id: c75359bcb24b4beb8de99809d2bef6fa Aug 24 07:49:27.950527 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Name: tempest-TestShelveInstance-1316834005 Aug 24 07:49:27.950527 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Role: reader,member Aug 24 07:49:27.950527 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Roles: reader,member Aug 24 07:49:27.952817 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c75359bcb24b4beb8de99809d2bef6fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c75359bcb24b4beb8de99809d2bef6fa", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c75359bcb24b4beb8de99809d2bef6fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c75359bcb24b4beb8de99809d2bef6fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:49:27.952817 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant: tempest-TestShelveInstance-1316834005 Aug 24 07:49:27.952817 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Id: c75359bcb24b4beb8de99809d2bef6fa Aug 24 07:49:27.952817 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Name: tempest-TestShelveInstance-1316834005 Aug 24 07:49:27.952817 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User: tempest-TestShelveInstance-1316834005-project Aug 24 07:49:27.952817 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Id: default Aug 24 07:49:27.952817 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Name: Default Aug 24 07:49:27.952817 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Id: 75bdaeec19be45388613c7e22aa009db Aug 24 07:49:27.952817 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Name: tempest-TestShelveInstance-1316834005-project Aug 24 07:49:27.952817 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: method: > Aug 24 07:49:27.952817 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: exception: Instance b258660f-e099-4e37-ab2a-4049ad88a647 could not be found. Aug 24 07:49:27.952817 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: action_args: {'id': 'b258660f-e099-4e37-ab2a-4049ad88a647'} Aug 24 07:49:27.953960 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:49:27.953960 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:49:27.953960 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:49:27.953960 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:49:27.953960 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:49:27.953960 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:49:27.953960 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:49:27.953960 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:49:27.953960 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:49:27.953960 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:49:27.953960 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b258660f-e099-4e37-ab2a-4049ad88a647 could not be found. Aug 24 07:49:27.953960 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:49:27.953960 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:49:27.953960 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:49:27.953960 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:49:27.953960 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:49:27.953960 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:49:27.953960 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:49:27.953960 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:49:27.953960 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:49:27.955593 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:49:27.955593 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 07:49:27.955593 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 07:49:27.955593 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:49:27.955593 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:49:27.955593 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:49:27.955593 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:49:27.955593 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b258660f-e099-4e37-ab2a-4049ad88a647 could not be found. Aug 24 07:49:27.955593 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:49:27.955593 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:49:27.955593 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:49:27.955593 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:49:27.955593 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:49:27.955593 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:49:27.955593 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:49:27.955593 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:49:27.955593 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b258660f-e099-4e37-ab2a-4049ad88a647 could not be found. Aug 24 07:49:27.955593 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:49:27.957052 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-03eb63e3-0641-48d8-a76e-b2e7d07e384f tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Returning 404 to user: Instance b258660f-e099-4e37-ab2a-4049ad88a647 could not be found. {{(pid=127114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:49:27.957052 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-03eb63e3-0641-48d8-a76e-b2e7d07e384f tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647" status: 404 len: 111 microversion: 2.1 time: 0.033736 Aug 24 07:49:27.957052 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 481/953] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:49:27 2022] GET /compute/v2.1/servers/b258660f-e099-4e37-ab2a-4049ad88a647 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:49:28.126353 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-46bf759b-9036-447c-bb5c-9f70581d5e68 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] Calling method '.version_select at 0x7faf5bb133a0>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:28.152676 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-46bf759b-9036-447c-bb5c-9f70581d5e68 tempest-TestShelveInstance-1316834005 tempest-TestShelveInstance-1316834005-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-180187044" status: 202 len: 0 microversion: 2.1 time: 0.031244 Aug 24 07:49:28.153159 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 473/954] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Aug 24 07:49:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-180187044 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 07:49:28.558091 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-d1802ac2-9810-4623-bf59-31683ffa9ad2 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:28.558718 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-d1802ac2-9810-4623-bf59-31683ffa9ad2 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:49:28.565242 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d1802ac2-9810-4623-bf59-31683ffa9ad2 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:28.565723 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d1802ac2-9810-4623-bf59-31683ffa9ad2 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:28.566158 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d1802ac2-9810-4623-bf59-31683ffa9ad2 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:28.566881 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d1802ac2-9810-4623-bf59-31683ffa9ad2 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:28.567338 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d1802ac2-9810-4623-bf59-31683ffa9ad2 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:28.567755 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d1802ac2-9810-4623-bf59-31683ffa9ad2 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:28.711204 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-d1802ac2-9810-4623-bf59-31683ffa9ad2 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:28.723006 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-d1802ac2-9810-4623-bf59-31683ffa9ad2 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:28.725033 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-d1802ac2-9810-4623-bf59-31683ffa9ad2 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:28.726271 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-d1802ac2-9810-4623-bf59-31683ffa9ad2 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1743 microversion: 2.20 time: 0.172088 Aug 24 07:49:28.726862 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 482/955] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:49:28 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1743 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:49:29.750991 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-216b6ce7-89ee-4e70-a08d-15c0ca279914 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:29.752230 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-216b6ce7-89ee-4e70-a08d-15c0ca279914 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:49:29.761558 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-216b6ce7-89ee-4e70-a08d-15c0ca279914 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:29.762090 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-216b6ce7-89ee-4e70-a08d-15c0ca279914 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:29.762523 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-216b6ce7-89ee-4e70-a08d-15c0ca279914 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:29.763573 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-216b6ce7-89ee-4e70-a08d-15c0ca279914 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:29.764039 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-216b6ce7-89ee-4e70-a08d-15c0ca279914 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:29.764462 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-216b6ce7-89ee-4e70-a08d-15c0ca279914 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:30.055335 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-216b6ce7-89ee-4e70-a08d-15c0ca279914 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:30.064145 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-216b6ce7-89ee-4e70-a08d-15c0ca279914 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:30.065851 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-216b6ce7-89ee-4e70-a08d-15c0ca279914 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:30.067238 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-216b6ce7-89ee-4e70-a08d-15c0ca279914 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1743 microversion: 2.20 time: 0.321584 Aug 24 07:49:30.067909 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 474/956] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:49:29 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1743 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:49:31.096378 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-b2962637-3b2d-469a-adaf-0b2ea234a671 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:31.096979 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-b2962637-3b2d-469a-adaf-0b2ea234a671 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:49:31.103590 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b2962637-3b2d-469a-adaf-0b2ea234a671 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:31.104316 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b2962637-3b2d-469a-adaf-0b2ea234a671 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:31.104753 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b2962637-3b2d-469a-adaf-0b2ea234a671 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:31.105628 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b2962637-3b2d-469a-adaf-0b2ea234a671 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:31.106089 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b2962637-3b2d-469a-adaf-0b2ea234a671 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:31.106517 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b2962637-3b2d-469a-adaf-0b2ea234a671 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:31.248836 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-b2962637-3b2d-469a-adaf-0b2ea234a671 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:31.260684 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-b2962637-3b2d-469a-adaf-0b2ea234a671 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:31.262579 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-b2962637-3b2d-469a-adaf-0b2ea234a671 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:31.264011 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-b2962637-3b2d-469a-adaf-0b2ea234a671 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1738 microversion: 2.20 time: 0.172011 Aug 24 07:49:31.265582 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 483/957] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:49:31 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1738 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:49:31.855570 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [req-3be53aeb-bff6-4465-a897-93db28a4f3df req-2f08d844-e6d0-4cda-968f-2bdae68fc095 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b6989bb-cd52-41ca-8e21-3e282a7c2445", "name": "network-vif-plugged", "status": "completed", "tag": "25bbb1a5-7b86-4b2e-9eea-4f302d25b92f"}]} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:49:31.871367 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-3be53aeb-bff6-4465-a897-93db28a4f3df req-2f08d844-e6d0-4cda-968f-2bdae68fc095 service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:31.872260 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-3be53aeb-bff6-4465-a897-93db28a4f3df req-2f08d844-e6d0-4cda-968f-2bdae68fc095 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:31.872737 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-3be53aeb-bff6-4465-a897-93db28a4f3df req-2f08d844-e6d0-4cda-968f-2bdae68fc095 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:31.887407 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.compute.server_external_events [req-3be53aeb-bff6-4465-a897-93db28a4f3df req-2f08d844-e6d0-4cda-968f-2bdae68fc095 service nova] Creating event network-vif-plugged:25bbb1a5-7b86-4b2e-9eea-4f302d25b92f for instance 6b6989bb-cd52-41ca-8e21-3e282a7c2445 on hv-cinder-85427 Aug 24 07:49:31.892958 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [req-3be53aeb-bff6-4465-a897-93db28a4f3df req-2f08d844-e6d0-4cda-968f-2bdae68fc095 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041706 Aug 24 07:49:31.894228 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 475/958] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:49:32.289477 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-8dde4e86-526e-42eb-9848-5324f970dc9c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:32.291054 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-8dde4e86-526e-42eb-9848-5324f970dc9c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:49:32.299996 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8dde4e86-526e-42eb-9848-5324f970dc9c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:32.301008 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8dde4e86-526e-42eb-9848-5324f970dc9c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:32.301782 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8dde4e86-526e-42eb-9848-5324f970dc9c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:32.304081 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8dde4e86-526e-42eb-9848-5324f970dc9c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:32.304786 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8dde4e86-526e-42eb-9848-5324f970dc9c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:32.306330 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8dde4e86-526e-42eb-9848-5324f970dc9c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:32.563085 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-8dde4e86-526e-42eb-9848-5324f970dc9c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:32.576088 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-8dde4e86-526e-42eb-9848-5324f970dc9c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:32.583974 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-8dde4e86-526e-42eb-9848-5324f970dc9c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:32.586137 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-8dde4e86-526e-42eb-9848-5324f970dc9c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1738 microversion: 2.20 time: 0.300608 Aug 24 07:49:32.602655 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 484/959] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:49:32 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1738 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:49:33.610587 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-7173fa45-ffc9-4acb-a269-409ed79a3853 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:33.611342 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-7173fa45-ffc9-4acb-a269-409ed79a3853 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:49:33.620889 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7173fa45-ffc9-4acb-a269-409ed79a3853 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:33.632996 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7173fa45-ffc9-4acb-a269-409ed79a3853 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:33.633649 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7173fa45-ffc9-4acb-a269-409ed79a3853 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:33.634515 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7173fa45-ffc9-4acb-a269-409ed79a3853 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:33.635120 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7173fa45-ffc9-4acb-a269-409ed79a3853 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:33.635645 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7173fa45-ffc9-4acb-a269-409ed79a3853 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:33.850209 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-7173fa45-ffc9-4acb-a269-409ed79a3853 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:33.863264 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-7173fa45-ffc9-4acb-a269-409ed79a3853 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:33.865473 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-7173fa45-ffc9-4acb-a269-409ed79a3853 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:33.867215 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-7173fa45-ffc9-4acb-a269-409ed79a3853 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1738 microversion: 2.20 time: 0.261856 Aug 24 07:49:33.868304 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 476/960] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:49:33 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1738 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:49:34.890017 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-1af3353a-6125-4eac-b455-56a720aa3207 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:34.891487 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-1af3353a-6125-4eac-b455-56a720aa3207 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:49:34.901242 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1af3353a-6125-4eac-b455-56a720aa3207 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:34.902302 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1af3353a-6125-4eac-b455-56a720aa3207 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:34.902924 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1af3353a-6125-4eac-b455-56a720aa3207 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:34.903836 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1af3353a-6125-4eac-b455-56a720aa3207 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:34.904460 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1af3353a-6125-4eac-b455-56a720aa3207 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:34.905051 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1af3353a-6125-4eac-b455-56a720aa3207 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:35.107831 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-1af3353a-6125-4eac-b455-56a720aa3207 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:35.121987 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-1af3353a-6125-4eac-b455-56a720aa3207 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:35.126041 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-1af3353a-6125-4eac-b455-56a720aa3207 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:35.127825 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-1af3353a-6125-4eac-b455-56a720aa3207 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1738 microversion: 2.20 time: 0.242262 Aug 24 07:49:35.129216 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 485/961] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:49:34 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1738 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:49:36.154723 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-4280eaa6-ea6f-4933-865b-fad73c280f42 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:36.155507 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-4280eaa6-ea6f-4933-865b-fad73c280f42 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:49:36.162209 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4280eaa6-ea6f-4933-865b-fad73c280f42 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:36.162687 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4280eaa6-ea6f-4933-865b-fad73c280f42 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:36.163324 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4280eaa6-ea6f-4933-865b-fad73c280f42 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:36.164052 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4280eaa6-ea6f-4933-865b-fad73c280f42 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:36.164478 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4280eaa6-ea6f-4933-865b-fad73c280f42 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:36.164893 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4280eaa6-ea6f-4933-865b-fad73c280f42 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:36.368922 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-4280eaa6-ea6f-4933-865b-fad73c280f42 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:36.379258 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-4280eaa6-ea6f-4933-865b-fad73c280f42 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:36.381309 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-4280eaa6-ea6f-4933-865b-fad73c280f42 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:36.382892 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-4280eaa6-ea6f-4933-865b-fad73c280f42 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1738 microversion: 2.20 time: 0.232014 Aug 24 07:49:36.383756 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 477/962] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:49:36 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1738 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:49:37.406836 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-13798985-6da6-42bf-92b2-5275d76481ba tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:37.407595 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-13798985-6da6-42bf-92b2-5275d76481ba tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:49:37.415268 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-13798985-6da6-42bf-92b2-5275d76481ba tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:37.415909 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-13798985-6da6-42bf-92b2-5275d76481ba tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:37.416453 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-13798985-6da6-42bf-92b2-5275d76481ba tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:37.417307 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-13798985-6da6-42bf-92b2-5275d76481ba tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:37.417880 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-13798985-6da6-42bf-92b2-5275d76481ba tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:37.418409 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-13798985-6da6-42bf-92b2-5275d76481ba tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:37.572270 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-13798985-6da6-42bf-92b2-5275d76481ba tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:37.575757 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:37.590086 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-13798985-6da6-42bf-92b2-5275d76481ba tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:37.594315 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-13798985-6da6-42bf-92b2-5275d76481ba tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:37.595553 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-13798985-6da6-42bf-92b2-5275d76481ba tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1738 microversion: 2.20 time: 0.193954 Aug 24 07:49:37.596120 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 486/963] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:49:37 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1738 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:49:38.620865 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-2119d9b8-e996-42c3-8504-b9bf4f81eaaf tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:38.622207 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-2119d9b8-e996-42c3-8504-b9bf4f81eaaf tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:49:38.629131 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2119d9b8-e996-42c3-8504-b9bf4f81eaaf tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:38.629890 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2119d9b8-e996-42c3-8504-b9bf4f81eaaf tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:38.630482 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2119d9b8-e996-42c3-8504-b9bf4f81eaaf tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:38.631387 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2119d9b8-e996-42c3-8504-b9bf4f81eaaf tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:38.631830 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2119d9b8-e996-42c3-8504-b9bf4f81eaaf tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:38.632428 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2119d9b8-e996-42c3-8504-b9bf4f81eaaf tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:38.785599 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-2119d9b8-e996-42c3-8504-b9bf4f81eaaf tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:38.795869 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-2119d9b8-e996-42c3-8504-b9bf4f81eaaf tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:38.798251 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-2119d9b8-e996-42c3-8504-b9bf4f81eaaf tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:38.799452 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-2119d9b8-e996-42c3-8504-b9bf4f81eaaf tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1738 microversion: 2.20 time: 0.183210 Aug 24 07:49:38.813888 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 478/964] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:49:38 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1738 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:49:39.831727 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-77f03b9d-3b92-43e3-a036-84e0b57706ce tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:39.831727 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-77f03b9d-3b92-43e3-a036-84e0b57706ce tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:49:39.839436 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-77f03b9d-3b92-43e3-a036-84e0b57706ce tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:39.840202 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-77f03b9d-3b92-43e3-a036-84e0b57706ce tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:39.841473 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-77f03b9d-3b92-43e3-a036-84e0b57706ce tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:39.842295 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-77f03b9d-3b92-43e3-a036-84e0b57706ce tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:39.842784 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-77f03b9d-3b92-43e3-a036-84e0b57706ce tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:39.843220 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-77f03b9d-3b92-43e3-a036-84e0b57706ce tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:39.990442 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-77f03b9d-3b92-43e3-a036-84e0b57706ce tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:40.003800 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-77f03b9d-3b92-43e3-a036-84e0b57706ce tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:40.005510 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-77f03b9d-3b92-43e3-a036-84e0b57706ce tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:40.006981 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-77f03b9d-3b92-43e3-a036-84e0b57706ce tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1738 microversion: 2.20 time: 0.186353 Aug 24 07:49:40.008020 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 487/965] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:49:39 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:49:41.034213 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-735f3a95-7a23-4a46-af37-521e66f6a773 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:41.034857 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-735f3a95-7a23-4a46-af37-521e66f6a773 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:49:41.041455 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-735f3a95-7a23-4a46-af37-521e66f6a773 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:41.042043 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-735f3a95-7a23-4a46-af37-521e66f6a773 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:41.042383 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-735f3a95-7a23-4a46-af37-521e66f6a773 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:41.043108 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-735f3a95-7a23-4a46-af37-521e66f6a773 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:41.043562 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-735f3a95-7a23-4a46-af37-521e66f6a773 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:41.044049 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-735f3a95-7a23-4a46-af37-521e66f6a773 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:41.067363 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:41.187737 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-735f3a95-7a23-4a46-af37-521e66f6a773 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:41.196023 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-735f3a95-7a23-4a46-af37-521e66f6a773 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:41.197529 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-735f3a95-7a23-4a46-af37-521e66f6a773 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:41.198712 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-735f3a95-7a23-4a46-af37-521e66f6a773 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1738 microversion: 2.20 time: 0.168955 Aug 24 07:49:41.199282 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 479/966] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:49:41 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:49:42.221866 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-3aa1d299-4165-4bbb-9dc0-e334e4bb574e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:42.222470 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-3aa1d299-4165-4bbb-9dc0-e334e4bb574e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:49:42.224808 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:42.229683 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3aa1d299-4165-4bbb-9dc0-e334e4bb574e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:42.230171 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3aa1d299-4165-4bbb-9dc0-e334e4bb574e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:42.230603 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3aa1d299-4165-4bbb-9dc0-e334e4bb574e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:42.231332 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3aa1d299-4165-4bbb-9dc0-e334e4bb574e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:42.231784 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3aa1d299-4165-4bbb-9dc0-e334e4bb574e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:42.232212 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3aa1d299-4165-4bbb-9dc0-e334e4bb574e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:42.362630 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-3aa1d299-4165-4bbb-9dc0-e334e4bb574e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:42.371426 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-3aa1d299-4165-4bbb-9dc0-e334e4bb574e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:42.372921 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-3aa1d299-4165-4bbb-9dc0-e334e4bb574e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:42.374106 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-3aa1d299-4165-4bbb-9dc0-e334e4bb574e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1720 microversion: 2.20 time: 0.156649 Aug 24 07:49:42.374655 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 488/967] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:49:42 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:49:43.397999 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-041f87e9-e634-4917-b285-732b61bdb7d8 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:43.398647 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-041f87e9-e634-4917-b285-732b61bdb7d8 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:49:43.401498 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:43.409831 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-041f87e9-e634-4917-b285-732b61bdb7d8 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:43.410319 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-041f87e9-e634-4917-b285-732b61bdb7d8 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:43.410772 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-041f87e9-e634-4917-b285-732b61bdb7d8 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:43.411486 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-041f87e9-e634-4917-b285-732b61bdb7d8 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:43.411949 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-041f87e9-e634-4917-b285-732b61bdb7d8 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:43.412353 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-041f87e9-e634-4917-b285-732b61bdb7d8 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:43.609354 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-041f87e9-e634-4917-b285-732b61bdb7d8 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:43.618859 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-041f87e9-e634-4917-b285-732b61bdb7d8 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:43.620359 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-041f87e9-e634-4917-b285-732b61bdb7d8 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:43.621577 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-041f87e9-e634-4917-b285-732b61bdb7d8 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1720 microversion: 2.20 time: 0.228262 Aug 24 07:49:43.622129 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 480/968] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:49:43 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1720 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:49:44.644614 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-a8276846-8940-4ec1-94cb-65535d8576c0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:44.645215 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-a8276846-8940-4ec1-94cb-65535d8576c0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:49:44.651962 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a8276846-8940-4ec1-94cb-65535d8576c0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:44.652438 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a8276846-8940-4ec1-94cb-65535d8576c0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:44.652867 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a8276846-8940-4ec1-94cb-65535d8576c0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:44.653564 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a8276846-8940-4ec1-94cb-65535d8576c0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:44.654007 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a8276846-8940-4ec1-94cb-65535d8576c0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:44.654422 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a8276846-8940-4ec1-94cb-65535d8576c0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:44.813734 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-a8276846-8940-4ec1-94cb-65535d8576c0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:44.822210 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-a8276846-8940-4ec1-94cb-65535d8576c0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:44.823743 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-a8276846-8940-4ec1-94cb-65535d8576c0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:44.824910 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-a8276846-8940-4ec1-94cb-65535d8576c0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1663 microversion: 2.20 time: 0.184338 Aug 24 07:49:44.825662 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 489/969] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:49:44 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1663 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:49:44.852605 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-b6e20e2b-2c0b-4b28-adfc-9d6b3853cc04 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f90e59f-eded-4f75-b99f-244edd9db3a5"}} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:49:44.856385 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-b6e20e2b-2c0b-4b28-adfc-9d6b3853cc04 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:49:44.867861 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b6e20e2b-2c0b-4b28-adfc-9d6b3853cc04 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:44.868537 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b6e20e2b-2c0b-4b28-adfc-9d6b3853cc04 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:44.868984 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b6e20e2b-2c0b-4b28-adfc-9d6b3853cc04 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:44.869693 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b6e20e2b-2c0b-4b28-adfc-9d6b3853cc04 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:44.870160 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b6e20e2b-2c0b-4b28-adfc-9d6b3853cc04 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:44.870579 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b6e20e2b-2c0b-4b28-adfc-9d6b3853cc04 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:45.173376 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-b6e20e2b-2c0b-4b28-adfc-9d6b3853cc04 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "POST /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.328068 Aug 24 07:49:45.174531 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 481/970] 10.222.0.42 () {62 vars in 1364 bytes} [Wed Aug 24 07:49:44 2022] POST /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445/os-volume_attachments => generated 188 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 07:49:45.309928 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-c1849c2b-7ad5-43d8-9512-e36e3945c68c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:45.310458 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-c1849c2b-7ad5-43d8-9512-e36e3945c68c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:49:45.316809 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c1849c2b-7ad5-43d8-9512-e36e3945c68c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:45.317315 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c1849c2b-7ad5-43d8-9512-e36e3945c68c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:45.317745 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c1849c2b-7ad5-43d8-9512-e36e3945c68c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:45.318444 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c1849c2b-7ad5-43d8-9512-e36e3945c68c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:45.318933 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c1849c2b-7ad5-43d8-9512-e36e3945c68c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:45.319361 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c1849c2b-7ad5-43d8-9512-e36e3945c68c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:45.589292 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-c1849c2b-7ad5-43d8-9512-e36e3945c68c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445/os-volume_attachments/6f90e59f-eded-4f75-b99f-244edd9db3a5" status: 202 len: 0 microversion: 2.20 time: 0.285175 Aug 24 07:49:45.589885 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 490/971] 10.222.0.42 () {60 vars in 1457 bytes} [Wed Aug 24 07:49:45 2022] DELETE /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445/os-volume_attachments/6f90e59f-eded-4f75-b99f-244edd9db3a5 => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 07:49:45.661943 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-a9cb6090-c234-4c2f-9644-3356a96fdef6 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:49:45.662540 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-a9cb6090-c234-4c2f-9644-3356a96fdef6 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:49:45.668871 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a9cb6090-c234-4c2f-9644-3356a96fdef6 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:45.669366 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a9cb6090-c234-4c2f-9644-3356a96fdef6 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:45.669792 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a9cb6090-c234-4c2f-9644-3356a96fdef6 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:45.670512 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a9cb6090-c234-4c2f-9644-3356a96fdef6 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:45.670997 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a9cb6090-c234-4c2f-9644-3356a96fdef6 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:45.671421 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a9cb6090-c234-4c2f-9644-3356a96fdef6 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:45.721396 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-a9cb6090-c234-4c2f-9644-3356a96fdef6 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127113) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 07:49:45.793981 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [req-dd767c7f-93b7-4f05-bc88-82fa4209cad6 req-4e4be9d1-e319-4b6e-91ae-65768c2bd14d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b6989bb-cd52-41ca-8e21-3e282a7c2445", "name": "network-vif-unplugged", "status": "completed", "tag": "25bbb1a5-7b86-4b2e-9eea-4f302d25b92f"}]} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:49:45.810186 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-dd767c7f-93b7-4f05-bc88-82fa4209cad6 req-4e4be9d1-e319-4b6e-91ae-65768c2bd14d service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:45.811288 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-dd767c7f-93b7-4f05-bc88-82fa4209cad6 req-4e4be9d1-e319-4b6e-91ae-65768c2bd14d service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:45.812951 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-dd767c7f-93b7-4f05-bc88-82fa4209cad6 req-4e4be9d1-e319-4b6e-91ae-65768c2bd14d service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:45.817981 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-a9cb6090-c234-4c2f-9644-3356a96fdef6 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "POST /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445/action" status: 202 len: 0 microversion: 2.20 time: 0.159152 Aug 24 07:49:45.820272 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 482/972] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Aug 24 07:49:45 2022] POST /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 07:49:45.836642 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.compute.server_external_events [req-dd767c7f-93b7-4f05-bc88-82fa4209cad6 req-4e4be9d1-e319-4b6e-91ae-65768c2bd14d service nova] Unable to find a host for instance 6b6989bb-cd52-41ca-8e21-3e282a7c2445. Dropping event network-vif-unplugged {{(pid=127114) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 07:49:45.838103 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-010f1efe-4e3a-4ed5-bd3e-ab7d945213fa tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:45.838324 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [req-dd767c7f-93b7-4f05-bc88-82fa4209cad6 req-4e4be9d1-e319-4b6e-91ae-65768c2bd14d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.050325 Aug 24 07:49:45.839785 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-010f1efe-4e3a-4ed5-bd3e-ab7d945213fa tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:49:45.840288 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 491/973] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 53 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 24 07:49:45.850540 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-010f1efe-4e3a-4ed5-bd3e-ab7d945213fa tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:45.851530 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-010f1efe-4e3a-4ed5-bd3e-ab7d945213fa tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:45.852303 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-010f1efe-4e3a-4ed5-bd3e-ab7d945213fa tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:45.853259 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-010f1efe-4e3a-4ed5-bd3e-ab7d945213fa tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:45.854182 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-010f1efe-4e3a-4ed5-bd3e-ab7d945213fa tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:45.854790 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-010f1efe-4e3a-4ed5-bd3e-ab7d945213fa tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:46.054231 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-010f1efe-4e3a-4ed5-bd3e-ab7d945213fa tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:46.070096 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-010f1efe-4e3a-4ed5-bd3e-ab7d945213fa tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:46.072976 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-010f1efe-4e3a-4ed5-bd3e-ab7d945213fa tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:46.075135 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-010f1efe-4e3a-4ed5-bd3e-ab7d945213fa tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1671 microversion: 2.20 time: 0.247802 Aug 24 07:49:46.075722 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 483/974] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:49:45 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1671 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:49:47.110822 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-c9518df3-cd45-4350-9ba9-bf4b728f0751 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:47.111472 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-c9518df3-cd45-4350-9ba9-bf4b728f0751 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:49:47.119238 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c9518df3-cd45-4350-9ba9-bf4b728f0751 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:47.119734 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c9518df3-cd45-4350-9ba9-bf4b728f0751 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:47.120285 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c9518df3-cd45-4350-9ba9-bf4b728f0751 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:47.121154 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c9518df3-cd45-4350-9ba9-bf4b728f0751 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:47.121723 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c9518df3-cd45-4350-9ba9-bf4b728f0751 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:47.122139 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c9518df3-cd45-4350-9ba9-bf4b728f0751 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:47.360477 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-c9518df3-cd45-4350-9ba9-bf4b728f0751 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:47.369016 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-c9518df3-cd45-4350-9ba9-bf4b728f0751 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:47.370539 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-c9518df3-cd45-4350-9ba9-bf4b728f0751 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:47.371769 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-c9518df3-cd45-4350-9ba9-bf4b728f0751 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1729 microversion: 2.20 time: 0.266159 Aug 24 07:49:47.372585 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 492/975] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:49:47 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1729 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:49:48.396033 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-2846013b-f483-4933-ac08-469df16fe117 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:48.397350 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-2846013b-f483-4933-ac08-469df16fe117 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:49:48.403878 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2846013b-f483-4933-ac08-469df16fe117 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:48.404694 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2846013b-f483-4933-ac08-469df16fe117 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:48.405133 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2846013b-f483-4933-ac08-469df16fe117 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:48.406528 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2846013b-f483-4933-ac08-469df16fe117 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:48.407089 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2846013b-f483-4933-ac08-469df16fe117 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:48.407513 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2846013b-f483-4933-ac08-469df16fe117 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:48.605145 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-2846013b-f483-4933-ac08-469df16fe117 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:48.618223 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-2846013b-f483-4933-ac08-469df16fe117 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:48.621299 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-2846013b-f483-4933-ac08-469df16fe117 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:48.623694 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-2846013b-f483-4933-ac08-469df16fe117 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1729 microversion: 2.20 time: 0.231189 Aug 24 07:49:48.624628 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 484/976] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:49:48 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1729 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 07:49:49.663926 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-55d586b6-32a6-4649-b2a4-3eaa6a4ab017 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:49.664801 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-55d586b6-32a6-4649-b2a4-3eaa6a4ab017 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:49:49.675852 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-55d586b6-32a6-4649-b2a4-3eaa6a4ab017 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:49.676627 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-55d586b6-32a6-4649-b2a4-3eaa6a4ab017 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:49.677592 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-55d586b6-32a6-4649-b2a4-3eaa6a4ab017 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:49.679105 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-55d586b6-32a6-4649-b2a4-3eaa6a4ab017 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:49.680199 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-55d586b6-32a6-4649-b2a4-3eaa6a4ab017 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:49.681134 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-55d586b6-32a6-4649-b2a4-3eaa6a4ab017 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:49.910840 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-55d586b6-32a6-4649-b2a4-3eaa6a4ab017 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:49.920251 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-55d586b6-32a6-4649-b2a4-3eaa6a4ab017 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:49.923063 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-55d586b6-32a6-4649-b2a4-3eaa6a4ab017 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:49.924270 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-55d586b6-32a6-4649-b2a4-3eaa6a4ab017 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1729 microversion: 2.20 time: 0.266978 Aug 24 07:49:49.924999 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 493/977] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:49:49 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1729 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 07:49:50.969116 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-9d65a58c-94dc-4bd7-ba9c-2be1ae283d91 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:50.970161 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-9d65a58c-94dc-4bd7-ba9c-2be1ae283d91 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:49:50.979187 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9d65a58c-94dc-4bd7-ba9c-2be1ae283d91 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:50.979846 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9d65a58c-94dc-4bd7-ba9c-2be1ae283d91 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:50.980398 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9d65a58c-94dc-4bd7-ba9c-2be1ae283d91 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:50.981240 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9d65a58c-94dc-4bd7-ba9c-2be1ae283d91 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:50.981811 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9d65a58c-94dc-4bd7-ba9c-2be1ae283d91 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:50.982346 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9d65a58c-94dc-4bd7-ba9c-2be1ae283d91 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:51.186714 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-9d65a58c-94dc-4bd7-ba9c-2be1ae283d91 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:51.199041 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-9d65a58c-94dc-4bd7-ba9c-2be1ae283d91 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:51.201192 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-9d65a58c-94dc-4bd7-ba9c-2be1ae283d91 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:51.203052 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-9d65a58c-94dc-4bd7-ba9c-2be1ae283d91 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1729 microversion: 2.20 time: 0.239617 Aug 24 07:49:51.204281 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 485/978] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:49:50 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1729 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 07:49:52.230227 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-df5a30e2-5fc6-4d98-986d-e41532ad6e3c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:52.231013 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-df5a30e2-5fc6-4d98-986d-e41532ad6e3c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:49:52.239463 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-df5a30e2-5fc6-4d98-986d-e41532ad6e3c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:52.240136 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-df5a30e2-5fc6-4d98-986d-e41532ad6e3c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:52.240590 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-df5a30e2-5fc6-4d98-986d-e41532ad6e3c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:52.241456 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-df5a30e2-5fc6-4d98-986d-e41532ad6e3c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:52.241980 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-df5a30e2-5fc6-4d98-986d-e41532ad6e3c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:52.242561 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-df5a30e2-5fc6-4d98-986d-e41532ad6e3c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:52.459525 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-df5a30e2-5fc6-4d98-986d-e41532ad6e3c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:52.476413 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-df5a30e2-5fc6-4d98-986d-e41532ad6e3c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:52.481309 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-df5a30e2-5fc6-4d98-986d-e41532ad6e3c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:52.483505 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-df5a30e2-5fc6-4d98-986d-e41532ad6e3c tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1729 microversion: 2.20 time: 0.256905 Aug 24 07:49:52.498537 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 494/979] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:49:52 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1729 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:49:53.516077 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-b262fe00-cb89-4670-bc1d-612114a9baab tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:53.516703 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-b262fe00-cb89-4670-bc1d-612114a9baab tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:49:53.523983 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b262fe00-cb89-4670-bc1d-612114a9baab tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:53.524487 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b262fe00-cb89-4670-bc1d-612114a9baab tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:53.524920 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b262fe00-cb89-4670-bc1d-612114a9baab tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:53.525639 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b262fe00-cb89-4670-bc1d-612114a9baab tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:53.526302 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b262fe00-cb89-4670-bc1d-612114a9baab tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:53.526789 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b262fe00-cb89-4670-bc1d-612114a9baab tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:53.756204 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-b262fe00-cb89-4670-bc1d-612114a9baab tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:53.770095 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-b262fe00-cb89-4670-bc1d-612114a9baab tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:53.772522 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-b262fe00-cb89-4670-bc1d-612114a9baab tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:53.774293 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-b262fe00-cb89-4670-bc1d-612114a9baab tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1729 microversion: 2.20 time: 0.262098 Aug 24 07:49:53.775397 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 486/980] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:49:53 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1729 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:49:54.810144 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-376c4dec-b758-4f86-87d0-78f736ce71f9 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:54.811537 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-376c4dec-b758-4f86-87d0-78f736ce71f9 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:49:54.825726 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-376c4dec-b758-4f86-87d0-78f736ce71f9 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:54.826753 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-376c4dec-b758-4f86-87d0-78f736ce71f9 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:54.827667 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-376c4dec-b758-4f86-87d0-78f736ce71f9 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:54.829073 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-376c4dec-b758-4f86-87d0-78f736ce71f9 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:54.830085 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-376c4dec-b758-4f86-87d0-78f736ce71f9 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:54.831441 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-376c4dec-b758-4f86-87d0-78f736ce71f9 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:55.049035 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-376c4dec-b758-4f86-87d0-78f736ce71f9 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:55.083571 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-376c4dec-b758-4f86-87d0-78f736ce71f9 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:55.089281 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-376c4dec-b758-4f86-87d0-78f736ce71f9 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:55.092776 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-376c4dec-b758-4f86-87d0-78f736ce71f9 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1729 microversion: 2.20 time: 0.292369 Aug 24 07:49:55.117026 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 495/981] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:49:54 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1729 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:49:56.130007 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-aa9f5c34-d422-41e0-afb6-3e93a3ea3cef tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:56.130864 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-aa9f5c34-d422-41e0-afb6-3e93a3ea3cef tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:49:56.142924 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-aa9f5c34-d422-41e0-afb6-3e93a3ea3cef tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:56.143569 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-aa9f5c34-d422-41e0-afb6-3e93a3ea3cef tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:56.144168 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-aa9f5c34-d422-41e0-afb6-3e93a3ea3cef tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:56.145257 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-aa9f5c34-d422-41e0-afb6-3e93a3ea3cef tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:56.145834 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-aa9f5c34-d422-41e0-afb6-3e93a3ea3cef tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:56.146359 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-aa9f5c34-d422-41e0-afb6-3e93a3ea3cef tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:56.376215 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-aa9f5c34-d422-41e0-afb6-3e93a3ea3cef tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:56.386750 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-aa9f5c34-d422-41e0-afb6-3e93a3ea3cef tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:56.388437 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-aa9f5c34-d422-41e0-afb6-3e93a3ea3cef tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:56.389407 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-aa9f5c34-d422-41e0-afb6-3e93a3ea3cef tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1729 microversion: 2.20 time: 0.264579 Aug 24 07:49:56.390665 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 487/982] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:49:56 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1729 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:49:57.416682 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-a55ef73c-f758-44ee-8322-863bb90c37be tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:57.417326 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-a55ef73c-f758-44ee-8322-863bb90c37be tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:49:57.424290 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a55ef73c-f758-44ee-8322-863bb90c37be tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:57.424767 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a55ef73c-f758-44ee-8322-863bb90c37be tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:57.425208 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a55ef73c-f758-44ee-8322-863bb90c37be tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:57.425900 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a55ef73c-f758-44ee-8322-863bb90c37be tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:57.426347 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a55ef73c-f758-44ee-8322-863bb90c37be tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:57.426805 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a55ef73c-f758-44ee-8322-863bb90c37be tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:57.584664 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-a55ef73c-f758-44ee-8322-863bb90c37be tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:57.593433 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-a55ef73c-f758-44ee-8322-863bb90c37be tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:57.596588 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-a55ef73c-f758-44ee-8322-863bb90c37be tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:57.596588 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-a55ef73c-f758-44ee-8322-863bb90c37be tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1729 microversion: 2.20 time: 0.183519 Aug 24 07:49:57.597105 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 496/983] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:49:57 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1729 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:49:58.622009 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-362e1d20-4286-4402-b5b2-49b661abc991 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:58.622747 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-362e1d20-4286-4402-b5b2-49b661abc991 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:49:58.630254 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-362e1d20-4286-4402-b5b2-49b661abc991 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:58.630768 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-362e1d20-4286-4402-b5b2-49b661abc991 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:58.631239 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-362e1d20-4286-4402-b5b2-49b661abc991 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:58.631962 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-362e1d20-4286-4402-b5b2-49b661abc991 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:58.632429 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-362e1d20-4286-4402-b5b2-49b661abc991 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:58.632854 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-362e1d20-4286-4402-b5b2-49b661abc991 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:58.790219 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-362e1d20-4286-4402-b5b2-49b661abc991 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:58.799672 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-362e1d20-4286-4402-b5b2-49b661abc991 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:58.801189 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-362e1d20-4286-4402-b5b2-49b661abc991 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:58.802369 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-362e1d20-4286-4402-b5b2-49b661abc991 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1729 microversion: 2.20 time: 0.184715 Aug 24 07:49:58.802964 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 488/984] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:49:58 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1729 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:49:59.825509 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-51703308-ece4-4cac-8f78-445a62bb167f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:49:59.826137 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-51703308-ece4-4cac-8f78-445a62bb167f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:49:59.833211 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-51703308-ece4-4cac-8f78-445a62bb167f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:59.833704 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-51703308-ece4-4cac-8f78-445a62bb167f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:59.834118 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-51703308-ece4-4cac-8f78-445a62bb167f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:59.834932 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-51703308-ece4-4cac-8f78-445a62bb167f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:49:59.835386 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-51703308-ece4-4cac-8f78-445a62bb167f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:49:59.835807 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-51703308-ece4-4cac-8f78-445a62bb167f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:49:59.977132 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-51703308-ece4-4cac-8f78-445a62bb167f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:59.985808 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-51703308-ece4-4cac-8f78-445a62bb167f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:59.987324 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-51703308-ece4-4cac-8f78-445a62bb167f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:49:59.988501 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-51703308-ece4-4cac-8f78-445a62bb167f tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1729 microversion: 2.20 time: 0.167007 Aug 24 07:49:59.989282 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 497/985] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:49:59 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:50:01.012132 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-a8b40ce1-865e-4a40-b454-31fff553583e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:50:01.012766 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-a8b40ce1-865e-4a40-b454-31fff553583e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:50:01.018684 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a8b40ce1-865e-4a40-b454-31fff553583e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:01.019198 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a8b40ce1-865e-4a40-b454-31fff553583e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:01.019629 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a8b40ce1-865e-4a40-b454-31fff553583e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:01.020323 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a8b40ce1-865e-4a40-b454-31fff553583e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:01.020772 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a8b40ce1-865e-4a40-b454-31fff553583e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:01.021194 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a8b40ce1-865e-4a40-b454-31fff553583e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:01.154609 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-a8b40ce1-865e-4a40-b454-31fff553583e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:50:01.163364 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-a8b40ce1-865e-4a40-b454-31fff553583e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:50:01.164866 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-a8b40ce1-865e-4a40-b454-31fff553583e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:50:01.166019 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-a8b40ce1-865e-4a40-b454-31fff553583e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1729 microversion: 2.20 time: 0.157957 Aug 24 07:50:01.166573 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 489/986] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:50:01 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:50:01.887512 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [req-abe1bef0-4e23-4e60-8856-2ac6b9ac0c0d req-03d473b8-04e0-48db-b28e-16fe3804de34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b6989bb-cd52-41ca-8e21-3e282a7c2445", "name": "network-vif-plugged", "status": "completed", "tag": "25bbb1a5-7b86-4b2e-9eea-4f302d25b92f"}]} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:50:01.899221 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-abe1bef0-4e23-4e60-8856-2ac6b9ac0c0d req-03d473b8-04e0-48db-b28e-16fe3804de34 service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:01.899722 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-abe1bef0-4e23-4e60-8856-2ac6b9ac0c0d req-03d473b8-04e0-48db-b28e-16fe3804de34 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:01.900156 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [req-abe1bef0-4e23-4e60-8856-2ac6b9ac0c0d req-03d473b8-04e0-48db-b28e-16fe3804de34 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:01.912040 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.compute.server_external_events [req-abe1bef0-4e23-4e60-8856-2ac6b9ac0c0d req-03d473b8-04e0-48db-b28e-16fe3804de34 service nova] Creating event network-vif-plugged:25bbb1a5-7b86-4b2e-9eea-4f302d25b92f for instance 6b6989bb-cd52-41ca-8e21-3e282a7c2445 on hv-cinder-85427 Aug 24 07:50:01.917421 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [req-abe1bef0-4e23-4e60-8856-2ac6b9ac0c0d req-03d473b8-04e0-48db-b28e-16fe3804de34 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033559 Aug 24 07:50:01.918372 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 498/987] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:50:02.188868 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-47039109-bf14-40a4-b48e-568c9f964f9e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:50:02.189471 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-47039109-bf14-40a4-b48e-568c9f964f9e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:50:02.195837 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-47039109-bf14-40a4-b48e-568c9f964f9e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:02.196317 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-47039109-bf14-40a4-b48e-568c9f964f9e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:02.196751 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-47039109-bf14-40a4-b48e-568c9f964f9e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:02.197437 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-47039109-bf14-40a4-b48e-568c9f964f9e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:02.197887 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-47039109-bf14-40a4-b48e-568c9f964f9e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:02.198305 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-47039109-bf14-40a4-b48e-568c9f964f9e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:02.325416 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-47039109-bf14-40a4-b48e-568c9f964f9e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:50:02.334186 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-47039109-bf14-40a4-b48e-568c9f964f9e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:50:02.335728 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-47039109-bf14-40a4-b48e-568c9f964f9e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:50:02.336888 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-47039109-bf14-40a4-b48e-568c9f964f9e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1729 microversion: 2.20 time: 0.152467 Aug 24 07:50:02.337432 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 490/988] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:50:02 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:50:03.359800 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-052ca8ad-554e-49e4-859b-5662487da202 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:50:03.361414 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-052ca8ad-554e-49e4-859b-5662487da202 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:50:03.368155 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-052ca8ad-554e-49e4-859b-5662487da202 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:03.368754 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-052ca8ad-554e-49e4-859b-5662487da202 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:03.369187 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-052ca8ad-554e-49e4-859b-5662487da202 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:03.370075 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-052ca8ad-554e-49e4-859b-5662487da202 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:03.370510 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-052ca8ad-554e-49e4-859b-5662487da202 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:03.370950 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-052ca8ad-554e-49e4-859b-5662487da202 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:03.509214 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-052ca8ad-554e-49e4-859b-5662487da202 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:50:03.517474 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-052ca8ad-554e-49e4-859b-5662487da202 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:50:03.519108 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-052ca8ad-554e-49e4-859b-5662487da202 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:50:03.520269 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-052ca8ad-554e-49e4-859b-5662487da202 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1729 microversion: 2.20 time: 0.164734 Aug 24 07:50:03.520834 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 499/989] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:50:03 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:50:04.542957 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-23a4f246-8943-4dbd-9b61-75050d901a8e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:50:04.543534 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-23a4f246-8943-4dbd-9b61-75050d901a8e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:50:04.550085 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-23a4f246-8943-4dbd-9b61-75050d901a8e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:04.550556 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-23a4f246-8943-4dbd-9b61-75050d901a8e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:04.550999 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-23a4f246-8943-4dbd-9b61-75050d901a8e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:04.551675 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-23a4f246-8943-4dbd-9b61-75050d901a8e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:04.552120 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-23a4f246-8943-4dbd-9b61-75050d901a8e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:04.552536 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-23a4f246-8943-4dbd-9b61-75050d901a8e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:04.857387 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-23a4f246-8943-4dbd-9b61-75050d901a8e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:50:04.865965 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-23a4f246-8943-4dbd-9b61-75050d901a8e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:50:04.867517 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-23a4f246-8943-4dbd-9b61-75050d901a8e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:50:04.868669 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-23a4f246-8943-4dbd-9b61-75050d901a8e tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1716 microversion: 2.20 time: 0.329647 Aug 24 07:50:04.869216 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 491/990] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:50:04 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1716 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:50:06.579205 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-2d9f04ef-70aa-4948-97d3-0402189d635f tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:50:06.579850 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-2d9f04ef-70aa-4948-97d3-0402189d635f tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 24a09aab-9508-4a08-a893-16eec8995ef8] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:50:06.580872 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [req-5870729d-4bd2-4922-911f-a30e61486f46 req-8bad9815-1a8c-4c37-9920-a738451d14e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24a09aab-9508-4a08-a893-16eec8995ef8", "tag": "c8813b7c-1c4b-464a-827b-33d862491a33"}]} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:50:06.587325 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2d9f04ef-70aa-4948-97d3-0402189d635f tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:06.588077 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2d9f04ef-70aa-4948-97d3-0402189d635f tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:06.588770 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2d9f04ef-70aa-4948-97d3-0402189d635f tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:06.589873 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2d9f04ef-70aa-4948-97d3-0402189d635f tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:06.590403 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2d9f04ef-70aa-4948-97d3-0402189d635f tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:06.590930 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2d9f04ef-70aa-4948-97d3-0402189d635f tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:06.591816 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-5870729d-4bd2-4922-911f-a30e61486f46 req-8bad9815-1a8c-4c37-9920-a738451d14e5 service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:06.592295 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-5870729d-4bd2-4922-911f-a30e61486f46 req-8bad9815-1a8c-4c37-9920-a738451d14e5 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:06.592720 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-5870729d-4bd2-4922-911f-a30e61486f46 req-8bad9815-1a8c-4c37-9920-a738451d14e5 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:06.606367 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.compute.server_external_events [req-5870729d-4bd2-4922-911f-a30e61486f46 req-8bad9815-1a8c-4c37-9920-a738451d14e5 service nova] Creating event network-changed:c8813b7c-1c4b-464a-827b-33d862491a33 for instance 24a09aab-9508-4a08-a893-16eec8995ef8 on hv-cinder-85427 Aug 24 07:50:06.611607 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [req-5870729d-4bd2-4922-911f-a30e61486f46 req-8bad9815-1a8c-4c37-9920-a738451d14e5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034945 Aug 24 07:50:06.612205 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 492/991] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:50:06.619894 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-2d9f04ef-70aa-4948-97d3-0402189d635f tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 24a09aab-9508-4a08-a893-16eec8995ef8] Going to try to terminate instance {{(pid=127114) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 07:50:06.681442 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=5 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:06.720397 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-2d9f04ef-70aa-4948-97d3-0402189d635f tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "DELETE /compute/v2.1/servers/24a09aab-9508-4a08-a893-16eec8995ef8" status: 204 len: 0 microversion: 2.1 time: 0.145751 Aug 24 07:50:06.721068 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 500/992] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 24 07:50:06 2022] DELETE /compute/v2.1/servers/24a09aab-9508-4a08-a893-16eec8995ef8 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 07:50:06.731028 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-34f4b027-edf9-45c9-abbf-406177affc5d tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:50:06.731826 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-34f4b027-edf9-45c9-abbf-406177affc5d tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 24a09aab-9508-4a08-a893-16eec8995ef8] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:50:06.739308 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-34f4b027-edf9-45c9-abbf-406177affc5d tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:06.739477 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-34f4b027-edf9-45c9-abbf-406177affc5d tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:06.739966 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-34f4b027-edf9-45c9-abbf-406177affc5d tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:06.740752 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-34f4b027-edf9-45c9-abbf-406177affc5d tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:06.741272 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-34f4b027-edf9-45c9-abbf-406177affc5d tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:06.741761 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-34f4b027-edf9-45c9-abbf-406177affc5d tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:06.745905 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:06.886396 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-34f4b027-edf9-45c9-abbf-406177affc5d tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:50:06.894588 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-34f4b027-edf9-45c9-abbf-406177affc5d tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/24a09aab-9508-4a08-a893-16eec8995ef8" status: 200 len: 1577 microversion: 2.1 time: 0.168794 Aug 24 07:50:06.895190 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 493/993] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:50:06 2022] GET /compute/v2.1/servers/24a09aab-9508-4a08-a893-16eec8995ef8 => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:50:07.916306 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-4a94dce2-d953-48a5-b0d4-d4d4ff8afa14 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:50:07.917003 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-4a94dce2-d953-48a5-b0d4-d4d4ff8afa14 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 24a09aab-9508-4a08-a893-16eec8995ef8] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:50:07.924013 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4a94dce2-d953-48a5-b0d4-d4d4ff8afa14 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:07.924493 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4a94dce2-d953-48a5-b0d4-d4d4ff8afa14 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:07.924926 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4a94dce2-d953-48a5-b0d4-d4d4ff8afa14 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:07.925709 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4a94dce2-d953-48a5-b0d4-d4d4ff8afa14 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:07.926166 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4a94dce2-d953-48a5-b0d4-d4d4ff8afa14 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:07.926592 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4a94dce2-d953-48a5-b0d4-d4d4ff8afa14 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:08.128396 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-4a94dce2-d953-48a5-b0d4-d4d4ff8afa14 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:50:08.136363 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-4a94dce2-d953-48a5-b0d4-d4d4ff8afa14 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/24a09aab-9508-4a08-a893-16eec8995ef8" status: 200 len: 1577 microversion: 2.1 time: 0.224410 Aug 24 07:50:08.137077 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 501/994] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:50:07 2022] GET /compute/v2.1/servers/24a09aab-9508-4a08-a893-16eec8995ef8 => generated 1577 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:50:08.626609 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [req-b399c4ea-6705-4ff9-923b-cc26f50ab7c4 req-e853b477-cfeb-4b01-9596-f21237e24274 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24a09aab-9508-4a08-a893-16eec8995ef8", "name": "network-vif-deleted", "tag": "c8813b7c-1c4b-464a-827b-33d862491a33"}]} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:50:08.636505 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-b399c4ea-6705-4ff9-923b-cc26f50ab7c4 req-e853b477-cfeb-4b01-9596-f21237e24274 service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:08.637063 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-b399c4ea-6705-4ff9-923b-cc26f50ab7c4 req-e853b477-cfeb-4b01-9596-f21237e24274 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:08.637498 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-b399c4ea-6705-4ff9-923b-cc26f50ab7c4 req-e853b477-cfeb-4b01-9596-f21237e24274 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:08.649470 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.compute.server_external_events [req-b399c4ea-6705-4ff9-923b-cc26f50ab7c4 req-e853b477-cfeb-4b01-9596-f21237e24274 service nova] Creating event network-vif-deleted:c8813b7c-1c4b-464a-827b-33d862491a33 for instance 24a09aab-9508-4a08-a893-16eec8995ef8 on hv-cinder-85427 Aug 24 07:50:08.654188 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [req-b399c4ea-6705-4ff9-923b-cc26f50ab7c4 req-e853b477-cfeb-4b01-9596-f21237e24274 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031227 Aug 24 07:50:08.654797 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 494/995] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:50:09.157928 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-82bee642-8530-45b8-9cdd-b0812e8edf35 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:50:09.158491 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-82bee642-8530-45b8-9cdd-b0812e8edf35 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 24a09aab-9508-4a08-a893-16eec8995ef8] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:50:09.166129 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-82bee642-8530-45b8-9cdd-b0812e8edf35 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:09.166828 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-82bee642-8530-45b8-9cdd-b0812e8edf35 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:09.167267 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-82bee642-8530-45b8-9cdd-b0812e8edf35 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:09.167961 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-82bee642-8530-45b8-9cdd-b0812e8edf35 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:09.168484 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-82bee642-8530-45b8-9cdd-b0812e8edf35 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:09.168975 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-82bee642-8530-45b8-9cdd-b0812e8edf35 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:09.201067 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-82bee642-8530-45b8-9cdd-b0812e8edf35 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:09.201545 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-82bee642-8530-45b8-9cdd-b0812e8edf35 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:09.201970 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-82bee642-8530-45b8-9cdd-b0812e8edf35 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:09.202412 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.objects.instance [None req-82bee642-8530-45b8-9cdd-b0812e8edf35 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lazy-loading 'fault' on Instance uuid 24a09aab-9508-4a08-a893-16eec8995ef8 {{(pid=127114) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:50:09.248888 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-82bee642-8530-45b8-9cdd-b0812e8edf35 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:50:09.256775 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-82bee642-8530-45b8-9cdd-b0812e8edf35 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/24a09aab-9508-4a08-a893-16eec8995ef8" status: 200 len: 1185 microversion: 2.1 time: 0.103136 Aug 24 07:50:09.257341 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 502/996] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:50:09 2022] GET /compute/v2.1/servers/24a09aab-9508-4a08-a893-16eec8995ef8 => generated 1185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:50:10.280866 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-5242291c-882a-4bdb-90cb-b73dac5eb800 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:50:10.281559 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-5242291c-882a-4bdb-90cb-b73dac5eb800 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 24a09aab-9508-4a08-a893-16eec8995ef8] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:50:10.287866 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5242291c-882a-4bdb-90cb-b73dac5eb800 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:10.288371 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5242291c-882a-4bdb-90cb-b73dac5eb800 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:10.288801 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5242291c-882a-4bdb-90cb-b73dac5eb800 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:10.289481 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5242291c-882a-4bdb-90cb-b73dac5eb800 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:10.289933 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5242291c-882a-4bdb-90cb-b73dac5eb800 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:10.290352 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5242291c-882a-4bdb-90cb-b73dac5eb800 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:10.304147 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.wsgi [None req-5242291c-882a-4bdb-90cb-b73dac5eb800 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] HTTP exception thrown: Instance 24a09aab-9508-4a08-a893-16eec8995ef8 could not be found. Aug 24 07:50:10.305740 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-5242291c-882a-4bdb-90cb-b73dac5eb800 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Request method failure captured: Aug 24 07:50:10.305740 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: request: GET /compute/v2.1/servers/24a09aab-9508-4a08-a893-16eec8995ef8 HTTP/1.1 Aug 24 07:50:10.305740 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept: application/json Aug 24 07:50:10.305740 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept-Encoding: identity Aug 24 07:50:10.305740 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Connection: close Aug 24 07:50:10.305740 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Length: 0 Aug 24 07:50:10.305740 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Type: application/json Aug 24 07:50:10.305740 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Host: 10.222.0.42 Aug 24 07:50:10.305740 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Openstack-System-Scope: None Aug 24 07:50:10.305740 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: User-Agent: python-urllib3/1.26.11 Aug 24 07:50:10.305740 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Auth-Token: gAAAAABjBdZqcBk483UUSWesWFTPKlAwMwjT5XV8JOe2-n-FOpuawHh1Z4gwimRsUqNiPmk2or-Qy4uvNRjWV6_WaL47uuFhZQsksiDoj5_mzRjIlg1vWHdzQ7HJAjC6-N06Kjn0WAOdyYuhZJQF8Rdz-zyv3MZxviUSVS6s6UQegvYiOsP_H4k Aug 24 07:50:10.305740 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Id: None Aug 24 07:50:10.305740 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Name: None Aug 24 07:50:10.305740 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Identity-Status: Confirmed Aug 24 07:50:10.305740 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Is-Admin-Project: True Aug 24 07:50:10.305740 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Id: default Aug 24 07:50:10.305740 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Name: Default Aug 24 07:50:10.305740 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Id: e97fd16d61ef4d5ebc5f435ae8a18561 Aug 24 07:50:10.305740 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Name: tempest-TestVolumeBootPattern-1549272169 Aug 24 07:50:10.305740 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Role: reader,member Aug 24 07:50:10.305740 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Roles: reader,member Aug 24 07:50:10.307292 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e97fd16d61ef4d5ebc5f435ae8a18561"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e97fd16d61ef4d5ebc5f435ae8a18561", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e97fd16d61ef4d5ebc5f435ae8a18561"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e97fd16d61ef4d5ebc5f435ae8a18561"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:50:10.307292 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant: tempest-TestVolumeBootPattern-1549272169 Aug 24 07:50:10.307292 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Id: e97fd16d61ef4d5ebc5f435ae8a18561 Aug 24 07:50:10.307292 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Name: tempest-TestVolumeBootPattern-1549272169 Aug 24 07:50:10.307292 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User: tempest-TestVolumeBootPattern-1549272169-project Aug 24 07:50:10.307292 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Id: default Aug 24 07:50:10.307292 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Name: Default Aug 24 07:50:10.307292 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Id: 760115e8fb554582a016445f9aadc00c Aug 24 07:50:10.307292 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Name: tempest-TestVolumeBootPattern-1549272169-project Aug 24 07:50:10.307292 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: method: > Aug 24 07:50:10.307292 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: exception: Instance 24a09aab-9508-4a08-a893-16eec8995ef8 could not be found. Aug 24 07:50:10.307292 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: action_args: {'id': '24a09aab-9508-4a08-a893-16eec8995ef8'} Aug 24 07:50:10.308127 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:50:10.308127 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:50:10.308127 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:50:10.308127 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:50:10.308127 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:50:10.308127 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:50:10.308127 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:50:10.308127 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:50:10.308127 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:50:10.308127 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:50:10.308127 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24a09aab-9508-4a08-a893-16eec8995ef8 could not be found. Aug 24 07:50:10.308127 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:50:10.308127 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:50:10.308127 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:50:10.308127 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:50:10.308127 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:50:10.308127 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:50:10.308127 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:50:10.308127 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:50:10.308127 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:50:10.309662 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:50:10.309662 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 07:50:10.309662 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 07:50:10.309662 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:50:10.309662 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:50:10.309662 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:50:10.309662 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:50:10.309662 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24a09aab-9508-4a08-a893-16eec8995ef8 could not be found. Aug 24 07:50:10.309662 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:50:10.309662 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:50:10.309662 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:50:10.309662 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:50:10.309662 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:50:10.309662 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:50:10.309662 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:50:10.309662 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:50:10.309662 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24a09aab-9508-4a08-a893-16eec8995ef8 could not be found. Aug 24 07:50:10.309662 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:50:10.311036 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-5242291c-882a-4bdb-90cb-b73dac5eb800 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Returning 404 to user: Instance 24a09aab-9508-4a08-a893-16eec8995ef8 could not be found. {{(pid=127113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:50:10.311036 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-5242291c-882a-4bdb-90cb-b73dac5eb800 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/24a09aab-9508-4a08-a893-16eec8995ef8" status: 404 len: 111 microversion: 2.1 time: 0.030920 Aug 24 07:50:10.311036 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 495/997] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:50:10 2022] GET /compute/v2.1/servers/24a09aab-9508-4a08-a893-16eec8995ef8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:50:13.349504 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-74aa300e-beb3-4b2d-904b-638cd56a0b3a tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:50:13.350179 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-74aa300e-beb3-4b2d-904b-638cd56a0b3a tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 0e77f06a-967d-4e17-9254-dd0237ec8d0e] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:50:13.351821 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [req-a437f042-c679-40fb-889c-07f917065f0e req-e8f36d88-c29c-4c49-8939-51bf39961822 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e77f06a-967d-4e17-9254-dd0237ec8d0e", "tag": "93a5f212-19aa-44d9-bf70-225e89f629ea"}]} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:50:13.354163 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:13.357750 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-74aa300e-beb3-4b2d-904b-638cd56a0b3a tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:13.358232 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-74aa300e-beb3-4b2d-904b-638cd56a0b3a tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:13.358666 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-74aa300e-beb3-4b2d-904b-638cd56a0b3a tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:13.359398 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-74aa300e-beb3-4b2d-904b-638cd56a0b3a tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:13.359850 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-74aa300e-beb3-4b2d-904b-638cd56a0b3a tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:13.361020 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-74aa300e-beb3-4b2d-904b-638cd56a0b3a tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:13.362681 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-a437f042-c679-40fb-889c-07f917065f0e req-e8f36d88-c29c-4c49-8939-51bf39961822 service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:13.363404 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-a437f042-c679-40fb-889c-07f917065f0e req-e8f36d88-c29c-4c49-8939-51bf39961822 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:13.364018 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-a437f042-c679-40fb-889c-07f917065f0e req-e8f36d88-c29c-4c49-8939-51bf39961822 service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:13.376325 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.compute.server_external_events [req-a437f042-c679-40fb-889c-07f917065f0e req-e8f36d88-c29c-4c49-8939-51bf39961822 service nova] Creating event network-changed:93a5f212-19aa-44d9-bf70-225e89f629ea for instance 0e77f06a-967d-4e17-9254-dd0237ec8d0e on hv-cinder-85427 Aug 24 07:50:13.381708 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [req-a437f042-c679-40fb-889c-07f917065f0e req-e8f36d88-c29c-4c49-8939-51bf39961822 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033729 Aug 24 07:50:13.382408 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 496/998] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:50:13.388383 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-74aa300e-beb3-4b2d-904b-638cd56a0b3a tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 0e77f06a-967d-4e17-9254-dd0237ec8d0e] Going to try to terminate instance {{(pid=127114) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 07:50:13.480066 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-74aa300e-beb3-4b2d-904b-638cd56a0b3a tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0e77f06a-967d-4e17-9254-dd0237ec8d0e" status: 204 len: 0 microversion: 2.1 time: 0.134205 Aug 24 07:50:13.482871 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 503/999] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 24 07:50:13 2022] DELETE /compute/v2.1/servers/0e77f06a-967d-4e17-9254-dd0237ec8d0e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 07:50:13.491654 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-1129610d-bedc-4605-91b8-2787bc490eed tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:50:13.492538 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-1129610d-bedc-4605-91b8-2787bc490eed tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 0e77f06a-967d-4e17-9254-dd0237ec8d0e] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:50:13.498299 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:13.501765 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1129610d-bedc-4605-91b8-2787bc490eed tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:13.502471 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1129610d-bedc-4605-91b8-2787bc490eed tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:13.503301 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1129610d-bedc-4605-91b8-2787bc490eed tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:13.504416 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1129610d-bedc-4605-91b8-2787bc490eed tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:13.505108 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1129610d-bedc-4605-91b8-2787bc490eed tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:13.505536 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1129610d-bedc-4605-91b8-2787bc490eed tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:13.667054 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-1129610d-bedc-4605-91b8-2787bc490eed tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:50:13.675595 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-1129610d-bedc-4605-91b8-2787bc490eed tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/0e77f06a-967d-4e17-9254-dd0237ec8d0e" status: 200 len: 1578 microversion: 2.1 time: 0.188786 Aug 24 07:50:13.676239 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 497/1000] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:50:13 2022] GET /compute/v2.1/servers/0e77f06a-967d-4e17-9254-dd0237ec8d0e => generated 1578 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:50:14.697656 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-7441917d-4041-48dc-aa6a-d86b1df8a25c tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:50:14.698269 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-7441917d-4041-48dc-aa6a-d86b1df8a25c tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 0e77f06a-967d-4e17-9254-dd0237ec8d0e] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:50:14.705413 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7441917d-4041-48dc-aa6a-d86b1df8a25c tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:14.705891 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7441917d-4041-48dc-aa6a-d86b1df8a25c tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:14.706327 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7441917d-4041-48dc-aa6a-d86b1df8a25c tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:14.707063 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7441917d-4041-48dc-aa6a-d86b1df8a25c tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:14.707511 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7441917d-4041-48dc-aa6a-d86b1df8a25c tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:14.707928 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7441917d-4041-48dc-aa6a-d86b1df8a25c tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:14.840053 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-7441917d-4041-48dc-aa6a-d86b1df8a25c tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:50:14.847869 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-7441917d-4041-48dc-aa6a-d86b1df8a25c tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/0e77f06a-967d-4e17-9254-dd0237ec8d0e" status: 200 len: 1578 microversion: 2.1 time: 0.154563 Aug 24 07:50:14.848432 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 504/1001] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:50:14 2022] GET /compute/v2.1/servers/0e77f06a-967d-4e17-9254-dd0237ec8d0e => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:50:15.428488 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [req-19feb06c-8625-4010-9bb3-e9ad411d2f64 req-2b25cd97-b8fb-4386-b8f2-b6f7bfb0f7fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e77f06a-967d-4e17-9254-dd0237ec8d0e", "name": "network-vif-deleted", "tag": "93a5f212-19aa-44d9-bf70-225e89f629ea"}]} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:50:15.438934 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-19feb06c-8625-4010-9bb3-e9ad411d2f64 req-2b25cd97-b8fb-4386-b8f2-b6f7bfb0f7fc service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:15.439411 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-19feb06c-8625-4010-9bb3-e9ad411d2f64 req-2b25cd97-b8fb-4386-b8f2-b6f7bfb0f7fc service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:15.439837 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-19feb06c-8625-4010-9bb3-e9ad411d2f64 req-2b25cd97-b8fb-4386-b8f2-b6f7bfb0f7fc service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:15.451757 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.compute.server_external_events [req-19feb06c-8625-4010-9bb3-e9ad411d2f64 req-2b25cd97-b8fb-4386-b8f2-b6f7bfb0f7fc service nova] Creating event network-vif-deleted:93a5f212-19aa-44d9-bf70-225e89f629ea for instance 0e77f06a-967d-4e17-9254-dd0237ec8d0e on hv-cinder-85427 Aug 24 07:50:15.456607 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [req-19feb06c-8625-4010-9bb3-e9ad411d2f64 req-2b25cd97-b8fb-4386-b8f2-b6f7bfb0f7fc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031743 Aug 24 07:50:15.457186 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 498/1002] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:50:15.868795 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-fe0991c3-8c5d-4985-99ae-bdb776f53235 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:50:15.869401 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-fe0991c3-8c5d-4985-99ae-bdb776f53235 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 0e77f06a-967d-4e17-9254-dd0237ec8d0e] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:50:15.876150 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fe0991c3-8c5d-4985-99ae-bdb776f53235 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:15.876627 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fe0991c3-8c5d-4985-99ae-bdb776f53235 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:15.877055 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fe0991c3-8c5d-4985-99ae-bdb776f53235 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:15.877733 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fe0991c3-8c5d-4985-99ae-bdb776f53235 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:15.878180 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fe0991c3-8c5d-4985-99ae-bdb776f53235 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:15.878596 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fe0991c3-8c5d-4985-99ae-bdb776f53235 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:15.908784 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fe0991c3-8c5d-4985-99ae-bdb776f53235 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:15.909248 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fe0991c3-8c5d-4985-99ae-bdb776f53235 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:15.909675 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fe0991c3-8c5d-4985-99ae-bdb776f53235 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:15.910106 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.objects.instance [None req-fe0991c3-8c5d-4985-99ae-bdb776f53235 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lazy-loading 'fault' on Instance uuid 0e77f06a-967d-4e17-9254-dd0237ec8d0e {{(pid=127114) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:50:15.951128 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-fe0991c3-8c5d-4985-99ae-bdb776f53235 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '760115e8fb554582a016445f9aadc00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97fd16d61ef4d5ebc5f435ae8a18561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:50:15.959496 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-fe0991c3-8c5d-4985-99ae-bdb776f53235 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/0e77f06a-967d-4e17-9254-dd0237ec8d0e" status: 200 len: 1231 microversion: 2.1 time: 0.094402 Aug 24 07:50:15.959911 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 505/1003] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:50:15 2022] GET /compute/v2.1/servers/0e77f06a-967d-4e17-9254-dd0237ec8d0e => generated 1231 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:50:16.981469 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-f17f6e17-8fd7-4807-a16b-6491e2233e36 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:50:16.982159 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-f17f6e17-8fd7-4807-a16b-6491e2233e36 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 0e77f06a-967d-4e17-9254-dd0237ec8d0e] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:50:16.988812 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f17f6e17-8fd7-4807-a16b-6491e2233e36 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:16.989285 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f17f6e17-8fd7-4807-a16b-6491e2233e36 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:16.989709 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f17f6e17-8fd7-4807-a16b-6491e2233e36 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:16.990413 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f17f6e17-8fd7-4807-a16b-6491e2233e36 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:16.990892 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f17f6e17-8fd7-4807-a16b-6491e2233e36 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:16.991309 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f17f6e17-8fd7-4807-a16b-6491e2233e36 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:17.003946 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.wsgi [None req-f17f6e17-8fd7-4807-a16b-6491e2233e36 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] HTTP exception thrown: Instance 0e77f06a-967d-4e17-9254-dd0237ec8d0e could not be found. Aug 24 07:50:17.005513 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-f17f6e17-8fd7-4807-a16b-6491e2233e36 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Request method failure captured: Aug 24 07:50:17.005513 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: request: GET /compute/v2.1/servers/0e77f06a-967d-4e17-9254-dd0237ec8d0e HTTP/1.1 Aug 24 07:50:17.005513 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept: application/json Aug 24 07:50:17.005513 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept-Encoding: identity Aug 24 07:50:17.005513 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Connection: close Aug 24 07:50:17.005513 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Length: 0 Aug 24 07:50:17.005513 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Type: application/json Aug 24 07:50:17.005513 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Host: 10.222.0.42 Aug 24 07:50:17.005513 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Openstack-System-Scope: None Aug 24 07:50:17.005513 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: User-Agent: python-urllib3/1.26.11 Aug 24 07:50:17.005513 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Auth-Token: gAAAAABjBdZqcBk483UUSWesWFTPKlAwMwjT5XV8JOe2-n-FOpuawHh1Z4gwimRsUqNiPmk2or-Qy4uvNRjWV6_WaL47uuFhZQsksiDoj5_mzRjIlg1vWHdzQ7HJAjC6-N06Kjn0WAOdyYuhZJQF8Rdz-zyv3MZxviUSVS6s6UQegvYiOsP_H4k Aug 24 07:50:17.005513 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Id: None Aug 24 07:50:17.005513 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Name: None Aug 24 07:50:17.005513 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Identity-Status: Confirmed Aug 24 07:50:17.005513 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Is-Admin-Project: True Aug 24 07:50:17.005513 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Id: default Aug 24 07:50:17.005513 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Name: Default Aug 24 07:50:17.005513 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Id: e97fd16d61ef4d5ebc5f435ae8a18561 Aug 24 07:50:17.005513 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Name: tempest-TestVolumeBootPattern-1549272169 Aug 24 07:50:17.005513 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Role: reader,member Aug 24 07:50:17.005513 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Roles: reader,member Aug 24 07:50:17.006899 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e97fd16d61ef4d5ebc5f435ae8a18561"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e97fd16d61ef4d5ebc5f435ae8a18561", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e97fd16d61ef4d5ebc5f435ae8a18561"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e97fd16d61ef4d5ebc5f435ae8a18561"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:50:17.006899 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant: tempest-TestVolumeBootPattern-1549272169 Aug 24 07:50:17.006899 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Id: e97fd16d61ef4d5ebc5f435ae8a18561 Aug 24 07:50:17.006899 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Name: tempest-TestVolumeBootPattern-1549272169 Aug 24 07:50:17.006899 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User: tempest-TestVolumeBootPattern-1549272169-project Aug 24 07:50:17.006899 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Id: default Aug 24 07:50:17.006899 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Name: Default Aug 24 07:50:17.006899 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Id: 760115e8fb554582a016445f9aadc00c Aug 24 07:50:17.006899 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Name: tempest-TestVolumeBootPattern-1549272169-project Aug 24 07:50:17.006899 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: method: > Aug 24 07:50:17.006899 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: exception: Instance 0e77f06a-967d-4e17-9254-dd0237ec8d0e could not be found. Aug 24 07:50:17.006899 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: action_args: {'id': '0e77f06a-967d-4e17-9254-dd0237ec8d0e'} Aug 24 07:50:17.007754 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:50:17.007754 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:50:17.007754 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:50:17.007754 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:50:17.007754 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:50:17.007754 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:50:17.007754 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:50:17.007754 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:50:17.007754 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:50:17.007754 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:50:17.007754 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e77f06a-967d-4e17-9254-dd0237ec8d0e could not be found. Aug 24 07:50:17.007754 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:50:17.007754 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:50:17.007754 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:50:17.007754 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:50:17.007754 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:50:17.007754 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:50:17.007754 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:50:17.007754 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:50:17.007754 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:50:17.009344 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:50:17.009344 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 07:50:17.009344 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 07:50:17.009344 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:50:17.009344 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:50:17.009344 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:50:17.009344 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:50:17.009344 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e77f06a-967d-4e17-9254-dd0237ec8d0e could not be found. Aug 24 07:50:17.009344 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:50:17.009344 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:50:17.009344 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:50:17.009344 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:50:17.009344 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:50:17.009344 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:50:17.009344 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:50:17.009344 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:50:17.009344 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e77f06a-967d-4e17-9254-dd0237ec8d0e could not be found. Aug 24 07:50:17.009344 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:50:17.010761 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-f17f6e17-8fd7-4807-a16b-6491e2233e36 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Returning 404 to user: Instance 0e77f06a-967d-4e17-9254-dd0237ec8d0e could not be found. {{(pid=127113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:50:17.010761 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-f17f6e17-8fd7-4807-a16b-6491e2233e36 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/0e77f06a-967d-4e17-9254-dd0237ec8d0e" status: 404 len: 111 microversion: 2.1 time: 0.030220 Aug 24 07:50:17.010761 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 499/1004] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:50:16 2022] GET /compute/v2.1/servers/0e77f06a-967d-4e17-9254-dd0237ec8d0e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:50:17.445515 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-f20f3207-6ca8-4f02-977d-bb3d06ea4c11 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:50:17.446032 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-f20f3207-6ca8-4f02-977d-bb3d06ea4c11 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 6f20697e-980b-4345-addc-d4907757ff37] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:50:17.452390 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f20f3207-6ca8-4f02-977d-bb3d06ea4c11 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:17.452876 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f20f3207-6ca8-4f02-977d-bb3d06ea4c11 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:17.453307 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f20f3207-6ca8-4f02-977d-bb3d06ea4c11 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:17.454499 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f20f3207-6ca8-4f02-977d-bb3d06ea4c11 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:17.454974 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f20f3207-6ca8-4f02-977d-bb3d06ea4c11 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:17.455399 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f20f3207-6ca8-4f02-977d-bb3d06ea4c11 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:17.471727 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.wsgi [None req-f20f3207-6ca8-4f02-977d-bb3d06ea4c11 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] HTTP exception thrown: Instance 6f20697e-980b-4345-addc-d4907757ff37 could not be found. Aug 24 07:50:17.473371 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-f20f3207-6ca8-4f02-977d-bb3d06ea4c11 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Request method failure captured: Aug 24 07:50:17.473371 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: request: DELETE /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37 HTTP/1.1 Aug 24 07:50:17.473371 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept: application/json Aug 24 07:50:17.473371 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept-Encoding: identity Aug 24 07:50:17.473371 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Connection: close Aug 24 07:50:17.473371 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Length: 0 Aug 24 07:50:17.473371 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Type: application/json Aug 24 07:50:17.473371 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Host: 10.222.0.42 Aug 24 07:50:17.473371 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Openstack-System-Scope: None Aug 24 07:50:17.473371 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: User-Agent: python-urllib3/1.26.11 Aug 24 07:50:17.473371 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Auth-Token: gAAAAABjBdZqcBk483UUSWesWFTPKlAwMwjT5XV8JOe2-n-FOpuawHh1Z4gwimRsUqNiPmk2or-Qy4uvNRjWV6_WaL47uuFhZQsksiDoj5_mzRjIlg1vWHdzQ7HJAjC6-N06Kjn0WAOdyYuhZJQF8Rdz-zyv3MZxviUSVS6s6UQegvYiOsP_H4k Aug 24 07:50:17.473371 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Id: None Aug 24 07:50:17.473371 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Name: None Aug 24 07:50:17.473371 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Identity-Status: Confirmed Aug 24 07:50:17.473371 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Is-Admin-Project: True Aug 24 07:50:17.473371 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Id: default Aug 24 07:50:17.473371 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Name: Default Aug 24 07:50:17.473371 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Id: e97fd16d61ef4d5ebc5f435ae8a18561 Aug 24 07:50:17.473371 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Name: tempest-TestVolumeBootPattern-1549272169 Aug 24 07:50:17.473371 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Role: reader,member Aug 24 07:50:17.473371 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Roles: reader,member Aug 24 07:50:17.474682 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e97fd16d61ef4d5ebc5f435ae8a18561"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e97fd16d61ef4d5ebc5f435ae8a18561", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e97fd16d61ef4d5ebc5f435ae8a18561"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e97fd16d61ef4d5ebc5f435ae8a18561"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:50:17.474682 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant: tempest-TestVolumeBootPattern-1549272169 Aug 24 07:50:17.474682 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Id: e97fd16d61ef4d5ebc5f435ae8a18561 Aug 24 07:50:17.474682 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Name: tempest-TestVolumeBootPattern-1549272169 Aug 24 07:50:17.474682 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User: tempest-TestVolumeBootPattern-1549272169-project Aug 24 07:50:17.474682 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Id: default Aug 24 07:50:17.474682 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Name: Default Aug 24 07:50:17.474682 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Id: 760115e8fb554582a016445f9aadc00c Aug 24 07:50:17.474682 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Name: tempest-TestVolumeBootPattern-1549272169-project Aug 24 07:50:17.474682 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: method: > Aug 24 07:50:17.474682 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: exception: Instance 6f20697e-980b-4345-addc-d4907757ff37 could not be found. Aug 24 07:50:17.474682 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: action_args: {'id': '6f20697e-980b-4345-addc-d4907757ff37'} Aug 24 07:50:17.475461 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:50:17.475461 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:50:17.475461 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:50:17.475461 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:50:17.475461 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:50:17.475461 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:50:17.475461 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:50:17.475461 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:50:17.475461 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:50:17.475461 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:50:17.475461 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f20697e-980b-4345-addc-d4907757ff37 could not be found. Aug 24 07:50:17.475461 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:50:17.475461 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:50:17.475461 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:50:17.475461 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:50:17.475461 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:50:17.475461 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:50:17.475461 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:50:17.475461 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:50:17.475461 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:50:17.476850 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:50:17.476850 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 07:50:17.476850 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 07:50:17.476850 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 07:50:17.476850 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 07:50:17.476850 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:50:17.476850 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:50:17.476850 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:50:17.476850 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:50:17.476850 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f20697e-980b-4345-addc-d4907757ff37 could not be found. Aug 24 07:50:17.476850 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:50:17.476850 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:50:17.476850 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:50:17.476850 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:50:17.476850 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:50:17.476850 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:50:17.476850 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:50:17.476850 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:50:17.476850 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f20697e-980b-4345-addc-d4907757ff37 could not be found. Aug 24 07:50:17.476850 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:50:17.478388 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-f20f3207-6ca8-4f02-977d-bb3d06ea4c11 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Returning 404 to user: Instance 6f20697e-980b-4345-addc-d4907757ff37 could not be found. {{(pid=127114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:50:17.478388 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-f20f3207-6ca8-4f02-977d-bb3d06ea4c11 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37" status: 404 len: 111 microversion: 2.1 time: 0.033147 Aug 24 07:50:17.478388 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 506/1005] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 24 07:50:17 2022] DELETE /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:50:17.483621 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-6390152d-f5a5-4748-a3f1-a2c37790137a tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:50:17.484253 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-6390152d-f5a5-4748-a3f1-a2c37790137a tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] [instance: 6f20697e-980b-4345-addc-d4907757ff37] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:50:17.490180 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6390152d-f5a5-4748-a3f1-a2c37790137a tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:17.490653 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6390152d-f5a5-4748-a3f1-a2c37790137a tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:17.491110 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6390152d-f5a5-4748-a3f1-a2c37790137a tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:17.491785 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6390152d-f5a5-4748-a3f1-a2c37790137a tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:17.492229 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6390152d-f5a5-4748-a3f1-a2c37790137a tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:17.492644 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6390152d-f5a5-4748-a3f1-a2c37790137a tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:17.505664 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.wsgi [None req-6390152d-f5a5-4748-a3f1-a2c37790137a tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] HTTP exception thrown: Instance 6f20697e-980b-4345-addc-d4907757ff37 could not be found. Aug 24 07:50:17.507203 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-6390152d-f5a5-4748-a3f1-a2c37790137a tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Request method failure captured: Aug 24 07:50:17.507203 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: request: GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37 HTTP/1.1 Aug 24 07:50:17.507203 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept: application/json Aug 24 07:50:17.507203 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept-Encoding: identity Aug 24 07:50:17.507203 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Connection: close Aug 24 07:50:17.507203 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Length: 0 Aug 24 07:50:17.507203 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Type: application/json Aug 24 07:50:17.507203 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Host: 10.222.0.42 Aug 24 07:50:17.507203 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Openstack-System-Scope: None Aug 24 07:50:17.507203 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: User-Agent: python-urllib3/1.26.11 Aug 24 07:50:17.507203 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Auth-Token: gAAAAABjBdZqcBk483UUSWesWFTPKlAwMwjT5XV8JOe2-n-FOpuawHh1Z4gwimRsUqNiPmk2or-Qy4uvNRjWV6_WaL47uuFhZQsksiDoj5_mzRjIlg1vWHdzQ7HJAjC6-N06Kjn0WAOdyYuhZJQF8Rdz-zyv3MZxviUSVS6s6UQegvYiOsP_H4k Aug 24 07:50:17.507203 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Id: None Aug 24 07:50:17.507203 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Name: None Aug 24 07:50:17.507203 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Identity-Status: Confirmed Aug 24 07:50:17.507203 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Is-Admin-Project: True Aug 24 07:50:17.507203 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Id: default Aug 24 07:50:17.507203 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Name: Default Aug 24 07:50:17.507203 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Id: e97fd16d61ef4d5ebc5f435ae8a18561 Aug 24 07:50:17.507203 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Name: tempest-TestVolumeBootPattern-1549272169 Aug 24 07:50:17.507203 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Role: reader,member Aug 24 07:50:17.507203 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Roles: reader,member Aug 24 07:50:17.508756 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e97fd16d61ef4d5ebc5f435ae8a18561"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e97fd16d61ef4d5ebc5f435ae8a18561", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e97fd16d61ef4d5ebc5f435ae8a18561"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e97fd16d61ef4d5ebc5f435ae8a18561"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:50:17.508756 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant: tempest-TestVolumeBootPattern-1549272169 Aug 24 07:50:17.508756 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Id: e97fd16d61ef4d5ebc5f435ae8a18561 Aug 24 07:50:17.508756 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Name: tempest-TestVolumeBootPattern-1549272169 Aug 24 07:50:17.508756 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User: tempest-TestVolumeBootPattern-1549272169-project Aug 24 07:50:17.508756 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Id: default Aug 24 07:50:17.508756 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Name: Default Aug 24 07:50:17.508756 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Id: 760115e8fb554582a016445f9aadc00c Aug 24 07:50:17.508756 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Name: tempest-TestVolumeBootPattern-1549272169-project Aug 24 07:50:17.508756 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: method: > Aug 24 07:50:17.508756 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: exception: Instance 6f20697e-980b-4345-addc-d4907757ff37 could not be found. Aug 24 07:50:17.508756 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: action_args: {'id': '6f20697e-980b-4345-addc-d4907757ff37'} Aug 24 07:50:17.509562 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:50:17.509562 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:50:17.509562 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:50:17.509562 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:50:17.509562 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:50:17.509562 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:50:17.509562 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:50:17.509562 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:50:17.509562 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:50:17.509562 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:50:17.509562 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f20697e-980b-4345-addc-d4907757ff37 could not be found. Aug 24 07:50:17.509562 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:50:17.509562 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:50:17.509562 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:50:17.509562 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:50:17.509562 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:50:17.509562 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:50:17.509562 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:50:17.509562 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:50:17.509562 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:50:17.510854 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:50:17.510854 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 07:50:17.510854 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 07:50:17.510854 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:50:17.510854 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:50:17.510854 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:50:17.510854 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:50:17.510854 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f20697e-980b-4345-addc-d4907757ff37 could not be found. Aug 24 07:50:17.510854 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:50:17.510854 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:50:17.510854 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:50:17.510854 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:50:17.510854 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:50:17.510854 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:50:17.510854 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:50:17.510854 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:50:17.510854 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f20697e-980b-4345-addc-d4907757ff37 could not be found. Aug 24 07:50:17.510854 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:50:17.511971 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-6390152d-f5a5-4748-a3f1-a2c37790137a tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Returning 404 to user: Instance 6f20697e-980b-4345-addc-d4907757ff37 could not be found. {{(pid=127113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:50:17.511971 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-6390152d-f5a5-4748-a3f1-a2c37790137a tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37" status: 404 len: 111 microversion: 2.1 time: 0.028801 Aug 24 07:50:17.511971 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 500/1006] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:50:17 2022] GET /compute/v2.1/servers/6f20697e-980b-4345-addc-d4907757ff37 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:50:18.799918 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-b664ee46-3120-44e0-a9d5-805cb848b2a2 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] Calling method '.version_select at 0x7faf685b9a60>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:50:18.821410 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-b664ee46-3120-44e0-a9d5-805cb848b2a2 tempest-TestVolumeBootPattern-1549272169 tempest-TestVolumeBootPattern-1549272169-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2141614004" status: 202 len: 0 microversion: 2.1 time: 0.025748 Aug 24 07:50:18.821793 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 507/1007] 10.222.0.42 () {58 vars in 1263 bytes} [Wed Aug 24 07:50:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2141614004 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 07:50:33.436458 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-efc10c53-6fbb-4981-b733-535ea7d54c10 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:50:33.439259 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-efc10c53-6fbb-4981-b733-535ea7d54c10 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:50:33.441557 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_api:SELECT=7 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:33.442193 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell1:SELECT=22 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:33.448784 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-efc10c53-6fbb-4981-b733-535ea7d54c10 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:33.449275 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-efc10c53-6fbb-4981-b733-535ea7d54c10 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:33.449713 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-efc10c53-6fbb-4981-b733-535ea7d54c10 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:33.450420 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-efc10c53-6fbb-4981-b733-535ea7d54c10 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:33.450911 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-efc10c53-6fbb-4981-b733-535ea7d54c10 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:33.451339 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-efc10c53-6fbb-4981-b733-535ea7d54c10 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:33.484479 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-efc10c53-6fbb-4981-b733-535ea7d54c10 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052115 Aug 24 07:50:33.485108 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 501/1008] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Aug 24 07:50:33 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:50:33.549258 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-1096b80e-d080-4a83-b9f3-be4ab94028f0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:50:33.549868 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-1096b80e-d080-4a83-b9f3-be4ab94028f0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:50:33.551983 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=44,nova_cell1:UPDATE=1 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:33.552841 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:33.559529 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1096b80e-d080-4a83-b9f3-be4ab94028f0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:33.560007 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1096b80e-d080-4a83-b9f3-be4ab94028f0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:33.560441 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1096b80e-d080-4a83-b9f3-be4ab94028f0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:33.561173 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1096b80e-d080-4a83-b9f3-be4ab94028f0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:33.561612 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1096b80e-d080-4a83-b9f3-be4ab94028f0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:33.562029 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1096b80e-d080-4a83-b9f3-be4ab94028f0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:33.597293 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-1096b80e-d080-4a83-b9f3-be4ab94028f0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Going to try to terminate instance {{(pid=127114) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 07:50:33.677136 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-1096b80e-d080-4a83-b9f3-be4ab94028f0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 204 len: 0 microversion: 2.20 time: 0.131745 Aug 24 07:50:33.678342 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 508/1009] 10.222.0.42 () {60 vars in 1280 bytes} [Wed Aug 24 07:50:33 2022] DELETE /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 07:50:33.687251 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-29f7e422-d45a-406e-b6ba-286ce84c53a9 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:50:33.687856 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-29f7e422-d45a-406e-b6ba-286ce84c53a9 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:50:33.695403 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-29f7e422-d45a-406e-b6ba-286ce84c53a9 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:33.695917 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-29f7e422-d45a-406e-b6ba-286ce84c53a9 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:33.696351 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-29f7e422-d45a-406e-b6ba-286ce84c53a9 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:33.697047 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-29f7e422-d45a-406e-b6ba-286ce84c53a9 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:33.697499 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-29f7e422-d45a-406e-b6ba-286ce84c53a9 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:33.697917 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-29f7e422-d45a-406e-b6ba-286ce84c53a9 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:33.832791 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-29f7e422-d45a-406e-b6ba-286ce84c53a9 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:50:33.841034 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-29f7e422-d45a-406e-b6ba-286ce84c53a9 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:50:33.842534 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-29f7e422-d45a-406e-b6ba-286ce84c53a9 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:50:33.843718 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-29f7e422-d45a-406e-b6ba-286ce84c53a9 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1722 microversion: 2.20 time: 0.160751 Aug 24 07:50:33.844294 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 502/1010] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:50:33 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:50:34.866761 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-6210c097-b85b-4ec3-a7a4-88d27b18f9b0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:50:34.867457 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-6210c097-b85b-4ec3-a7a4-88d27b18f9b0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:50:34.874088 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6210c097-b85b-4ec3-a7a4-88d27b18f9b0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:34.874568 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6210c097-b85b-4ec3-a7a4-88d27b18f9b0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:34.875023 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6210c097-b85b-4ec3-a7a4-88d27b18f9b0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:34.876258 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6210c097-b85b-4ec3-a7a4-88d27b18f9b0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:34.876710 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6210c097-b85b-4ec3-a7a4-88d27b18f9b0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:34.877133 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6210c097-b85b-4ec3-a7a4-88d27b18f9b0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:35.014864 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-6210c097-b85b-4ec3-a7a4-88d27b18f9b0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:50:35.023878 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-6210c097-b85b-4ec3-a7a4-88d27b18f9b0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:50:35.025434 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-6210c097-b85b-4ec3-a7a4-88d27b18f9b0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:50:35.026557 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-6210c097-b85b-4ec3-a7a4-88d27b18f9b0 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1722 microversion: 2.20 time: 0.164081 Aug 24 07:50:35.027152 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 509/1011] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:50:34 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:50:35.850476 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [req-426c93a7-e09a-430f-93fc-29f0479a0264 req-ab3350cd-be71-47f4-8b28-da93a9ed495b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b6989bb-cd52-41ca-8e21-3e282a7c2445", "name": "network-vif-deleted", "tag": "25bbb1a5-7b86-4b2e-9eea-4f302d25b92f"}]} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:50:35.861725 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-426c93a7-e09a-430f-93fc-29f0479a0264 req-ab3350cd-be71-47f4-8b28-da93a9ed495b service nova] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:35.862200 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-426c93a7-e09a-430f-93fc-29f0479a0264 req-ab3350cd-be71-47f4-8b28-da93a9ed495b service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:35.862624 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [req-426c93a7-e09a-430f-93fc-29f0479a0264 req-ab3350cd-be71-47f4-8b28-da93a9ed495b service nova] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:35.882265 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.compute.server_external_events [req-426c93a7-e09a-430f-93fc-29f0479a0264 req-ab3350cd-be71-47f4-8b28-da93a9ed495b service nova] Creating event network-vif-deleted:25bbb1a5-7b86-4b2e-9eea-4f302d25b92f for instance 6b6989bb-cd52-41ca-8e21-3e282a7c2445 on hv-cinder-85427 Aug 24 07:50:35.882604 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [req-426c93a7-e09a-430f-93fc-29f0479a0264 req-ab3350cd-be71-47f4-8b28-da93a9ed495b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035117 Aug 24 07:50:35.884380 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 503/1012] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Aug 24 07:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:50:36.050146 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-14583038-069e-4339-a8fc-0545d4d9eccc tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:50:36.050957 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-14583038-069e-4339-a8fc-0545d4d9eccc tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:50:36.057779 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-14583038-069e-4339-a8fc-0545d4d9eccc tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:36.058265 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-14583038-069e-4339-a8fc-0545d4d9eccc tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:36.058716 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-14583038-069e-4339-a8fc-0545d4d9eccc tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:36.059423 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-14583038-069e-4339-a8fc-0545d4d9eccc tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:36.059876 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-14583038-069e-4339-a8fc-0545d4d9eccc tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:36.060291 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-14583038-069e-4339-a8fc-0545d4d9eccc tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:36.095977 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-14583038-069e-4339-a8fc-0545d4d9eccc tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:36.096461 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-14583038-069e-4339-a8fc-0545d4d9eccc tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:36.096887 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-14583038-069e-4339-a8fc-0545d4d9eccc tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:36.097331 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.objects.instance [None req-14583038-069e-4339-a8fc-0545d4d9eccc tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lazy-loading 'fault' on Instance uuid 6b6989bb-cd52-41ca-8e21-3e282a7c2445 {{(pid=127114) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:50:36.139785 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-14583038-069e-4339-a8fc-0545d4d9eccc tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:50:36.149705 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-14583038-069e-4339-a8fc-0545d4d9eccc tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:50:36.151463 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-14583038-069e-4339-a8fc-0545d4d9eccc tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a986ecc6e2644db8be8958b1eacfd5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337840b04c0b4135a83063dfc5dbe5f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:50:36.152876 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-14583038-069e-4339-a8fc-0545d4d9eccc tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 200 len: 1372 microversion: 2.20 time: 0.107918 Aug 24 07:50:36.153461 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 510/1013] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:50:36 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 1372 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 07:50:37.406321 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-715436ee-1a8b-47a1-a98e-56bdc69b8801 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:50:37.407045 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-715436ee-1a8b-47a1-a98e-56bdc69b8801 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:50:37.413261 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-715436ee-1a8b-47a1-a98e-56bdc69b8801 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:37.413747 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-715436ee-1a8b-47a1-a98e-56bdc69b8801 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:37.414178 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-715436ee-1a8b-47a1-a98e-56bdc69b8801 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:37.414905 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-715436ee-1a8b-47a1-a98e-56bdc69b8801 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:37.415358 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-715436ee-1a8b-47a1-a98e-56bdc69b8801 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:37.415776 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-715436ee-1a8b-47a1-a98e-56bdc69b8801 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:37.431515 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.wsgi [None req-715436ee-1a8b-47a1-a98e-56bdc69b8801 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] HTTP exception thrown: Instance 6b6989bb-cd52-41ca-8e21-3e282a7c2445 could not be found. Aug 24 07:50:37.433100 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-715436ee-1a8b-47a1-a98e-56bdc69b8801 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Request method failure captured: Aug 24 07:50:37.433100 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: request: GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 HTTP/1.1 Aug 24 07:50:37.433100 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept: application/json Aug 24 07:50:37.433100 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept-Encoding: identity Aug 24 07:50:37.433100 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Connection: close Aug 24 07:50:37.433100 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Length: 0 Aug 24 07:50:37.433100 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Type: application/json Aug 24 07:50:37.433100 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Host: 10.222.0.42 Aug 24 07:50:37.433100 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Openstack-System-Scope: None Aug 24 07:50:37.433100 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: User-Agent: python-urllib3/1.26.11 Aug 24 07:50:37.433100 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Auth-Token: gAAAAABjBdchmpAN70V5S3VyWq-C0dEmtA0zbwloeE-Z1d9F-hOycCodaGDVQkA5LsmJI6w02SIt58llNqBDCvbJzYE0qrrp8T3JeywroS8d_FGt167TbjpygWiMdKJLgWiPP7b4W3K-XByeGhWcHBgbAVRhClDbTLiuqysIOLKi-8c-Il1OZtI Aug 24 07:50:37.433100 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Id: None Aug 24 07:50:37.433100 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Name: None Aug 24 07:50:37.433100 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Identity-Status: Confirmed Aug 24 07:50:37.433100 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Is-Admin-Project: True Aug 24 07:50:37.433100 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 07:50:37.433100 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Id: default Aug 24 07:50:37.433100 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Name: Default Aug 24 07:50:37.433100 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Id: 337840b04c0b4135a83063dfc5dbe5f1 Aug 24 07:50:37.433100 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1796398509 Aug 24 07:50:37.433100 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Role: reader,member Aug 24 07:50:37.433100 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Roles: reader,member Aug 24 07:50:37.434861 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/337840b04c0b4135a83063dfc5dbe5f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_337840b04c0b4135a83063dfc5dbe5f1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/337840b04c0b4135a83063dfc5dbe5f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/337840b04c0b4135a83063dfc5dbe5f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:50:37.434861 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1796398509 Aug 24 07:50:37.434861 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Id: 337840b04c0b4135a83063dfc5dbe5f1 Aug 24 07:50:37.434861 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1796398509 Aug 24 07:50:37.434861 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User: tempest-AttachVolumeShelveTestJSON-1796398509-project Aug 24 07:50:37.434861 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Id: default Aug 24 07:50:37.434861 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Name: Default Aug 24 07:50:37.434861 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Id: a986ecc6e2644db8be8958b1eacfd5d6 Aug 24 07:50:37.434861 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1796398509-project Aug 24 07:50:37.434861 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: method: > Aug 24 07:50:37.434861 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: exception: Instance 6b6989bb-cd52-41ca-8e21-3e282a7c2445 could not be found. Aug 24 07:50:37.434861 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: action_args: {'id': '6b6989bb-cd52-41ca-8e21-3e282a7c2445'} Aug 24 07:50:37.435783 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:50:37.435783 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:50:37.435783 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:50:37.435783 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:50:37.435783 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:50:37.435783 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:50:37.435783 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:50:37.435783 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:50:37.435783 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:50:37.435783 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:50:37.435783 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b6989bb-cd52-41ca-8e21-3e282a7c2445 could not be found. Aug 24 07:50:37.435783 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:50:37.435783 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:50:37.435783 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:50:37.435783 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:50:37.435783 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:50:37.435783 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:50:37.435783 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:50:37.435783 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:50:37.435783 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:50:37.437284 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:50:37.437284 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 07:50:37.437284 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 07:50:37.437284 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:50:37.437284 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:50:37.437284 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:50:37.437284 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:50:37.437284 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b6989bb-cd52-41ca-8e21-3e282a7c2445 could not be found. Aug 24 07:50:37.437284 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:50:37.437284 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:50:37.437284 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:50:37.437284 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:50:37.437284 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:50:37.437284 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:50:37.437284 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:50:37.437284 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:50:37.437284 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b6989bb-cd52-41ca-8e21-3e282a7c2445 could not be found. Aug 24 07:50:37.437284 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:50:37.439396 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-715436ee-1a8b-47a1-a98e-56bdc69b8801 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Returning 404 to user: Instance 6b6989bb-cd52-41ca-8e21-3e282a7c2445 could not be found. {{(pid=127113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:50:37.439396 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-715436ee-1a8b-47a1-a98e-56bdc69b8801 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 404 len: 111 microversion: 2.20 time: 0.262813 Aug 24 07:50:37.439396 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 504/1014] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:50:37 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 111 bytes in 264 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 07:50:37.444095 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-6d17ee35-3fd3-48cd-9f39-81149988c636 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '.version_select at 0x7faf685b9820>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:50:37.463499 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-6d17ee35-3fd3-48cd-9f39-81149988c636 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1624962031" status: 204 len: 0 microversion: 2.20 time: 0.023097 Aug 24 07:50:37.464018 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 511/1015] 10.222.0.42 () {60 vars in 1262 bytes} [Wed Aug 24 07:50:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1624962031 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 07:50:39.239413 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-32cc0c3c-c475-42de-b16a-ce189be47dbb tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:50:39.239920 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-32cc0c3c-c475-42de-b16a-ce189be47dbb tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:50:39.246224 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-32cc0c3c-c475-42de-b16a-ce189be47dbb tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:39.246718 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-32cc0c3c-c475-42de-b16a-ce189be47dbb tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:39.247164 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-32cc0c3c-c475-42de-b16a-ce189be47dbb tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:39.247849 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-32cc0c3c-c475-42de-b16a-ce189be47dbb tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:39.248294 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-32cc0c3c-c475-42de-b16a-ce189be47dbb tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:39.248712 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-32cc0c3c-c475-42de-b16a-ce189be47dbb tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:39.263002 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.wsgi [None req-32cc0c3c-c475-42de-b16a-ce189be47dbb tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] HTTP exception thrown: Instance 6b6989bb-cd52-41ca-8e21-3e282a7c2445 could not be found. Aug 24 07:50:39.264563 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-32cc0c3c-c475-42de-b16a-ce189be47dbb tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Request method failure captured: Aug 24 07:50:39.264563 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: request: DELETE /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 HTTP/1.1 Aug 24 07:50:39.264563 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept: application/json Aug 24 07:50:39.264563 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept-Encoding: identity Aug 24 07:50:39.264563 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Connection: close Aug 24 07:50:39.264563 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Length: 0 Aug 24 07:50:39.264563 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Type: application/json Aug 24 07:50:39.264563 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Host: 10.222.0.42 Aug 24 07:50:39.264563 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Openstack-System-Scope: None Aug 24 07:50:39.264563 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: User-Agent: python-urllib3/1.26.11 Aug 24 07:50:39.264563 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Auth-Token: gAAAAABjBdchmpAN70V5S3VyWq-C0dEmtA0zbwloeE-Z1d9F-hOycCodaGDVQkA5LsmJI6w02SIt58llNqBDCvbJzYE0qrrp8T3JeywroS8d_FGt167TbjpygWiMdKJLgWiPP7b4W3K-XByeGhWcHBgbAVRhClDbTLiuqysIOLKi-8c-Il1OZtI Aug 24 07:50:39.264563 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Id: None Aug 24 07:50:39.264563 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Name: None Aug 24 07:50:39.264563 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Identity-Status: Confirmed Aug 24 07:50:39.264563 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Is-Admin-Project: True Aug 24 07:50:39.264563 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 07:50:39.264563 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Id: default Aug 24 07:50:39.264563 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Name: Default Aug 24 07:50:39.264563 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Id: 337840b04c0b4135a83063dfc5dbe5f1 Aug 24 07:50:39.264563 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1796398509 Aug 24 07:50:39.264563 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Role: reader,member Aug 24 07:50:39.264563 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Roles: reader,member Aug 24 07:50:39.266203 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/337840b04c0b4135a83063dfc5dbe5f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_337840b04c0b4135a83063dfc5dbe5f1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/337840b04c0b4135a83063dfc5dbe5f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/337840b04c0b4135a83063dfc5dbe5f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:50:39.266203 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1796398509 Aug 24 07:50:39.266203 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Id: 337840b04c0b4135a83063dfc5dbe5f1 Aug 24 07:50:39.266203 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1796398509 Aug 24 07:50:39.266203 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User: tempest-AttachVolumeShelveTestJSON-1796398509-project Aug 24 07:50:39.266203 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Id: default Aug 24 07:50:39.266203 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Name: Default Aug 24 07:50:39.266203 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Id: a986ecc6e2644db8be8958b1eacfd5d6 Aug 24 07:50:39.266203 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1796398509-project Aug 24 07:50:39.266203 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: method: > Aug 24 07:50:39.266203 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: exception: Instance 6b6989bb-cd52-41ca-8e21-3e282a7c2445 could not be found. Aug 24 07:50:39.266203 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: action_args: {'id': '6b6989bb-cd52-41ca-8e21-3e282a7c2445'} Aug 24 07:50:39.267108 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:50:39.267108 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:50:39.267108 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:50:39.267108 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:50:39.267108 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:50:39.267108 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:50:39.267108 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:50:39.267108 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:50:39.267108 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:50:39.267108 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:50:39.267108 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b6989bb-cd52-41ca-8e21-3e282a7c2445 could not be found. Aug 24 07:50:39.267108 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:50:39.267108 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:50:39.267108 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:50:39.267108 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:50:39.267108 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:50:39.267108 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:50:39.267108 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:50:39.267108 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:50:39.267108 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:50:39.268549 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:50:39.268549 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 07:50:39.268549 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 07:50:39.268549 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 07:50:39.268549 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 07:50:39.268549 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:50:39.268549 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:50:39.268549 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:50:39.268549 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:50:39.268549 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b6989bb-cd52-41ca-8e21-3e282a7c2445 could not be found. Aug 24 07:50:39.268549 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:50:39.268549 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:50:39.268549 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:50:39.268549 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:50:39.268549 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:50:39.268549 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:50:39.268549 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:50:39.268549 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:50:39.268549 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b6989bb-cd52-41ca-8e21-3e282a7c2445 could not be found. Aug 24 07:50:39.268549 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:50:39.269976 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-32cc0c3c-c475-42de-b16a-ce189be47dbb tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Returning 404 to user: Instance 6b6989bb-cd52-41ca-8e21-3e282a7c2445 could not be found. {{(pid=127113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:50:39.269976 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-32cc0c3c-c475-42de-b16a-ce189be47dbb tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 404 len: 111 microversion: 2.20 time: 0.030987 Aug 24 07:50:39.269976 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 505/1016] 10.222.0.42 () {60 vars in 1280 bytes} [Wed Aug 24 07:50:39 2022] DELETE /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 07:50:39.275405 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-8d96b651-d4ca-41db-bd06-bfdd9a1ac028 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:50:39.276016 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-8d96b651-d4ca-41db-bd06-bfdd9a1ac028 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: 6b6989bb-cd52-41ca-8e21-3e282a7c2445] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:50:39.284216 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8d96b651-d4ca-41db-bd06-bfdd9a1ac028 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:39.284802 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8d96b651-d4ca-41db-bd06-bfdd9a1ac028 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:39.285392 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8d96b651-d4ca-41db-bd06-bfdd9a1ac028 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:39.285961 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8d96b651-d4ca-41db-bd06-bfdd9a1ac028 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:39.286415 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8d96b651-d4ca-41db-bd06-bfdd9a1ac028 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:39.286868 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8d96b651-d4ca-41db-bd06-bfdd9a1ac028 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:39.301130 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.wsgi [None req-8d96b651-d4ca-41db-bd06-bfdd9a1ac028 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] HTTP exception thrown: Instance 6b6989bb-cd52-41ca-8e21-3e282a7c2445 could not be found. Aug 24 07:50:39.302732 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-8d96b651-d4ca-41db-bd06-bfdd9a1ac028 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Request method failure captured: Aug 24 07:50:39.302732 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: request: GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 HTTP/1.1 Aug 24 07:50:39.302732 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept: application/json Aug 24 07:50:39.302732 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept-Encoding: identity Aug 24 07:50:39.302732 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Connection: close Aug 24 07:50:39.302732 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Length: 0 Aug 24 07:50:39.302732 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Type: application/json Aug 24 07:50:39.302732 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Host: 10.222.0.42 Aug 24 07:50:39.302732 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Openstack-System-Scope: None Aug 24 07:50:39.302732 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: User-Agent: python-urllib3/1.26.11 Aug 24 07:50:39.302732 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Auth-Token: gAAAAABjBdchmpAN70V5S3VyWq-C0dEmtA0zbwloeE-Z1d9F-hOycCodaGDVQkA5LsmJI6w02SIt58llNqBDCvbJzYE0qrrp8T3JeywroS8d_FGt167TbjpygWiMdKJLgWiPP7b4W3K-XByeGhWcHBgbAVRhClDbTLiuqysIOLKi-8c-Il1OZtI Aug 24 07:50:39.302732 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Id: None Aug 24 07:50:39.302732 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Name: None Aug 24 07:50:39.302732 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Identity-Status: Confirmed Aug 24 07:50:39.302732 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Is-Admin-Project: True Aug 24 07:50:39.302732 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 07:50:39.302732 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Id: default Aug 24 07:50:39.302732 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Name: Default Aug 24 07:50:39.302732 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Id: 337840b04c0b4135a83063dfc5dbe5f1 Aug 24 07:50:39.302732 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1796398509 Aug 24 07:50:39.302732 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Role: reader,member Aug 24 07:50:39.302732 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Roles: reader,member Aug 24 07:50:39.304324 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/337840b04c0b4135a83063dfc5dbe5f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_337840b04c0b4135a83063dfc5dbe5f1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/337840b04c0b4135a83063dfc5dbe5f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/337840b04c0b4135a83063dfc5dbe5f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:50:39.304324 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1796398509 Aug 24 07:50:39.304324 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Id: 337840b04c0b4135a83063dfc5dbe5f1 Aug 24 07:50:39.304324 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1796398509 Aug 24 07:50:39.304324 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User: tempest-AttachVolumeShelveTestJSON-1796398509-project Aug 24 07:50:39.304324 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Id: default Aug 24 07:50:39.304324 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Name: Default Aug 24 07:50:39.304324 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Id: a986ecc6e2644db8be8958b1eacfd5d6 Aug 24 07:50:39.304324 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1796398509-project Aug 24 07:50:39.304324 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: method: > Aug 24 07:50:39.304324 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: exception: Instance 6b6989bb-cd52-41ca-8e21-3e282a7c2445 could not be found. Aug 24 07:50:39.304324 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: action_args: {'id': '6b6989bb-cd52-41ca-8e21-3e282a7c2445'} Aug 24 07:50:39.305269 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:50:39.305269 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:50:39.305269 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:50:39.305269 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:50:39.305269 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:50:39.305269 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:50:39.305269 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:50:39.305269 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:50:39.305269 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:50:39.305269 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:50:39.305269 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b6989bb-cd52-41ca-8e21-3e282a7c2445 could not be found. Aug 24 07:50:39.305269 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:50:39.305269 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:50:39.305269 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:50:39.305269 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:50:39.305269 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:50:39.305269 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:50:39.305269 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:50:39.305269 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:50:39.305269 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:50:39.306751 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:50:39.306751 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 07:50:39.306751 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 07:50:39.306751 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:50:39.306751 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:50:39.306751 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:50:39.306751 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:50:39.306751 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b6989bb-cd52-41ca-8e21-3e282a7c2445 could not be found. Aug 24 07:50:39.306751 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:50:39.306751 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:50:39.306751 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:50:39.306751 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:50:39.306751 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:50:39.306751 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:50:39.306751 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:50:39.306751 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:50:39.306751 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b6989bb-cd52-41ca-8e21-3e282a7c2445 could not be found. Aug 24 07:50:39.306751 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:50:39.308094 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-8d96b651-d4ca-41db-bd06-bfdd9a1ac028 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Returning 404 to user: Instance 6b6989bb-cd52-41ca-8e21-3e282a7c2445 could not be found. {{(pid=127114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:50:39.308094 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-8d96b651-d4ca-41db-bd06-bfdd9a1ac028 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445" status: 404 len: 111 microversion: 2.20 time: 0.033319 Aug 24 07:50:39.308094 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 512/1017] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:50:39 2022] GET /compute/v2.1/servers/6b6989bb-cd52-41ca-8e21-3e282a7c2445 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 24 07:50:40.444640 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-59f31cf0-9d24-4e00-916e-d2bda258a601 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:50:40.445301 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-59f31cf0-9d24-4e00-916e-d2bda258a601 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:50:40.451464 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-59f31cf0-9d24-4e00-916e-d2bda258a601 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:40.451942 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-59f31cf0-9d24-4e00-916e-d2bda258a601 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:40.452376 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-59f31cf0-9d24-4e00-916e-d2bda258a601 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:40.453065 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-59f31cf0-9d24-4e00-916e-d2bda258a601 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:40.453520 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-59f31cf0-9d24-4e00-916e-d2bda258a601 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:40.454126 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-59f31cf0-9d24-4e00-916e-d2bda258a601 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:40.467487 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.wsgi [None req-59f31cf0-9d24-4e00-916e-d2bda258a601 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] HTTP exception thrown: Instance a80b309c-fa06-43b7-be57-1dc3045b9651 could not be found. Aug 24 07:50:40.469033 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-59f31cf0-9d24-4e00-916e-d2bda258a601 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Request method failure captured: Aug 24 07:50:40.469033 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: request: DELETE /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 HTTP/1.1 Aug 24 07:50:40.469033 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept: application/json Aug 24 07:50:40.469033 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Accept-Encoding: identity Aug 24 07:50:40.469033 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Connection: close Aug 24 07:50:40.469033 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Length: 0 Aug 24 07:50:40.469033 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Content-Type: application/json Aug 24 07:50:40.469033 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Host: 10.222.0.42 Aug 24 07:50:40.469033 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Openstack-System-Scope: None Aug 24 07:50:40.469033 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: User-Agent: python-urllib3/1.26.11 Aug 24 07:50:40.469033 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Auth-Token: gAAAAABjBdchmpAN70V5S3VyWq-C0dEmtA0zbwloeE-Z1d9F-hOycCodaGDVQkA5LsmJI6w02SIt58llNqBDCvbJzYE0qrrp8T3JeywroS8d_FGt167TbjpygWiMdKJLgWiPP7b4W3K-XByeGhWcHBgbAVRhClDbTLiuqysIOLKi-8c-Il1OZtI Aug 24 07:50:40.469033 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Id: None Aug 24 07:50:40.469033 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Domain-Name: None Aug 24 07:50:40.469033 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Identity-Status: Confirmed Aug 24 07:50:40.469033 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Is-Admin-Project: True Aug 24 07:50:40.469033 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 07:50:40.469033 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Id: default Aug 24 07:50:40.469033 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Domain-Name: Default Aug 24 07:50:40.469033 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Id: 337840b04c0b4135a83063dfc5dbe5f1 Aug 24 07:50:40.469033 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1796398509 Aug 24 07:50:40.469033 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Role: reader,member Aug 24 07:50:40.469033 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Roles: reader,member Aug 24 07:50:40.470480 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/337840b04c0b4135a83063dfc5dbe5f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_337840b04c0b4135a83063dfc5dbe5f1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/337840b04c0b4135a83063dfc5dbe5f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/337840b04c0b4135a83063dfc5dbe5f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:50:40.470480 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1796398509 Aug 24 07:50:40.470480 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Id: 337840b04c0b4135a83063dfc5dbe5f1 Aug 24 07:50:40.470480 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1796398509 Aug 24 07:50:40.470480 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User: tempest-AttachVolumeShelveTestJSON-1796398509-project Aug 24 07:50:40.470480 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Id: default Aug 24 07:50:40.470480 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Domain-Name: Default Aug 24 07:50:40.470480 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Id: a986ecc6e2644db8be8958b1eacfd5d6 Aug 24 07:50:40.470480 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1796398509-project Aug 24 07:50:40.470480 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: method: > Aug 24 07:50:40.470480 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: exception: Instance a80b309c-fa06-43b7-be57-1dc3045b9651 could not be found. Aug 24 07:50:40.470480 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: action_args: {'id': 'a80b309c-fa06-43b7-be57-1dc3045b9651'} Aug 24 07:50:40.472257 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:50:40.472257 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:50:40.472257 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:50:40.472257 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:50:40.472257 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:50:40.472257 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:50:40.472257 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:50:40.472257 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:50:40.472257 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:50:40.472257 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:50:40.472257 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a80b309c-fa06-43b7-be57-1dc3045b9651 could not be found. Aug 24 07:50:40.472257 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:50:40.472257 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:50:40.472257 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:50:40.472257 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:50:40.472257 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:50:40.472257 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:50:40.472257 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:50:40.472257 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:50:40.472257 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:50:40.474044 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:50:40.474044 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 07:50:40.474044 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 07:50:40.474044 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 07:50:40.474044 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 07:50:40.474044 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:50:40.474044 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:50:40.474044 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:50:40.474044 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:50:40.474044 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a80b309c-fa06-43b7-be57-1dc3045b9651 could not be found. Aug 24 07:50:40.474044 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:50:40.474044 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:50:40.474044 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:50:40.474044 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:50:40.474044 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:50:40.474044 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:50:40.474044 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:50:40.474044 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:50:40.474044 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a80b309c-fa06-43b7-be57-1dc3045b9651 could not be found. Aug 24 07:50:40.474044 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: ERROR nova.api.openstack.wsgi Aug 24 07:50:40.475884 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-59f31cf0-9d24-4e00-916e-d2bda258a601 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Returning 404 to user: Instance a80b309c-fa06-43b7-be57-1dc3045b9651 could not be found. {{(pid=127113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:50:40.475884 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-59f31cf0-9d24-4e00-916e-d2bda258a601 tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 404 len: 111 microversion: 2.20 time: 0.029736 Aug 24 07:50:40.475884 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 506/1018] 10.222.0.42 () {60 vars in 1280 bytes} [Wed Aug 24 07:50:40 2022] DELETE /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 07:50:40.481665 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-808362d2-83bf-4402-968e-3e5882e082bd tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:50:40.482278 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-808362d2-83bf-4402-968e-3e5882e082bd tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] [instance: a80b309c-fa06-43b7-be57-1dc3045b9651] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:50:40.489562 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-808362d2-83bf-4402-968e-3e5882e082bd tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:40.490038 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-808362d2-83bf-4402-968e-3e5882e082bd tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:40.490473 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-808362d2-83bf-4402-968e-3e5882e082bd tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:40.491291 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-808362d2-83bf-4402-968e-3e5882e082bd tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:50:40.491746 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-808362d2-83bf-4402-968e-3e5882e082bd tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:50:40.492167 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-808362d2-83bf-4402-968e-3e5882e082bd tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:50:40.506313 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.wsgi [None req-808362d2-83bf-4402-968e-3e5882e082bd tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] HTTP exception thrown: Instance a80b309c-fa06-43b7-be57-1dc3045b9651 could not be found. Aug 24 07:50:40.508018 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-808362d2-83bf-4402-968e-3e5882e082bd tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Request method failure captured: Aug 24 07:50:40.508018 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: request: GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 HTTP/1.1 Aug 24 07:50:40.508018 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept: application/json Aug 24 07:50:40.508018 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept-Encoding: identity Aug 24 07:50:40.508018 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Connection: close Aug 24 07:50:40.508018 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Length: 0 Aug 24 07:50:40.508018 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Type: application/json Aug 24 07:50:40.508018 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Host: 10.222.0.42 Aug 24 07:50:40.508018 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Openstack-System-Scope: None Aug 24 07:50:40.508018 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: User-Agent: python-urllib3/1.26.11 Aug 24 07:50:40.508018 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Auth-Token: gAAAAABjBdchmpAN70V5S3VyWq-C0dEmtA0zbwloeE-Z1d9F-hOycCodaGDVQkA5LsmJI6w02SIt58llNqBDCvbJzYE0qrrp8T3JeywroS8d_FGt167TbjpygWiMdKJLgWiPP7b4W3K-XByeGhWcHBgbAVRhClDbTLiuqysIOLKi-8c-Il1OZtI Aug 24 07:50:40.508018 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Id: None Aug 24 07:50:40.508018 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Name: None Aug 24 07:50:40.508018 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Identity-Status: Confirmed Aug 24 07:50:40.508018 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Is-Admin-Project: True Aug 24 07:50:40.508018 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 07:50:40.508018 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Id: default Aug 24 07:50:40.508018 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Name: Default Aug 24 07:50:40.508018 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Id: 337840b04c0b4135a83063dfc5dbe5f1 Aug 24 07:50:40.508018 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1796398509 Aug 24 07:50:40.508018 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Role: reader,member Aug 24 07:50:40.508018 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Roles: reader,member Aug 24 07:50:40.509644 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/337840b04c0b4135a83063dfc5dbe5f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_337840b04c0b4135a83063dfc5dbe5f1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/337840b04c0b4135a83063dfc5dbe5f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/337840b04c0b4135a83063dfc5dbe5f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:50:40.509644 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1796398509 Aug 24 07:50:40.509644 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Id: 337840b04c0b4135a83063dfc5dbe5f1 Aug 24 07:50:40.509644 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1796398509 Aug 24 07:50:40.509644 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User: tempest-AttachVolumeShelveTestJSON-1796398509-project Aug 24 07:50:40.509644 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Id: default Aug 24 07:50:40.509644 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Name: Default Aug 24 07:50:40.509644 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Id: a986ecc6e2644db8be8958b1eacfd5d6 Aug 24 07:50:40.509644 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1796398509-project Aug 24 07:50:40.509644 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: method: > Aug 24 07:50:40.509644 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: exception: Instance a80b309c-fa06-43b7-be57-1dc3045b9651 could not be found. Aug 24 07:50:40.509644 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: action_args: {'id': 'a80b309c-fa06-43b7-be57-1dc3045b9651'} Aug 24 07:50:40.513624 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:50:40.513624 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:50:40.513624 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:50:40.513624 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:50:40.513624 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:50:40.513624 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:50:40.513624 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:50:40.513624 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:50:40.513624 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:50:40.513624 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:50:40.513624 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a80b309c-fa06-43b7-be57-1dc3045b9651 could not be found. Aug 24 07:50:40.513624 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:50:40.513624 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:50:40.513624 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:50:40.513624 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:50:40.513624 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:50:40.513624 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:50:40.513624 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:50:40.513624 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:50:40.513624 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:50:40.515133 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:50:40.515133 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 07:50:40.515133 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 07:50:40.515133 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:50:40.515133 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:50:40.515133 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:50:40.515133 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:50:40.515133 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a80b309c-fa06-43b7-be57-1dc3045b9651 could not be found. Aug 24 07:50:40.515133 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:50:40.515133 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:50:40.515133 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:50:40.515133 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:50:40.515133 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:50:40.515133 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:50:40.515133 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:50:40.515133 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:50:40.515133 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a80b309c-fa06-43b7-be57-1dc3045b9651 could not be found. Aug 24 07:50:40.515133 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:50:40.517161 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-808362d2-83bf-4402-968e-3e5882e082bd tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] Returning 404 to user: Instance a80b309c-fa06-43b7-be57-1dc3045b9651 could not be found. {{(pid=127114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:50:40.517161 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-808362d2-83bf-4402-968e-3e5882e082bd tempest-AttachVolumeShelveTestJSON-1796398509 tempest-AttachVolumeShelveTestJSON-1796398509-project] 10.222.0.42 "GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651" status: 404 len: 111 microversion: 2.20 time: 0.031688 Aug 24 07:50:40.517161 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 513/1019] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Aug 24 07:50:40 2022] GET /compute/v2.1/servers/a80b309c-fa06-43b7-be57-1dc3045b9651 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 07:52:40.349387 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_api:SELECT=12 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:40.350428 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell1:SELECT=20 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:40.355499 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-1a0990a5-9bb0-49bc-97b6-62c1e2bba0e8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Action: 'create', calling method: .version_select at 0x7faf5bd37af0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-200319513", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJbOOOiyRGa3SCxl7KvupUrPBe+La0fJ++TedDdhz9h/gssN6uniK0H1aten8h6P+/jFPvQKqFTwZb57qS7r3YfT5ZEeGd9Uw7qmX0LbQCpZu9SEit+FaipH/6IRRZRPw=="}} {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:52:40.372700 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.quota [None req-1a0990a5-9bb0-49bc-97b6-62c1e2bba0e8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Getting quotas for project f6a8a466e6a44ceb989ba40e429c625e. Resources: {'key_pairs'} {{(pid=127113) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:52:40.376782 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.quota [None req-1a0990a5-9bb0-49bc-97b6-62c1e2bba0e8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Getting quotas for user 48f23faea87840ecbf5b75753eb1d139 and project f6a8a466e6a44ceb989ba40e429c625e. Resources: {'key_pairs'} {{(pid=127113) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:52:40.408000 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-1a0990a5-9bb0-49bc-97b6-62c1e2bba0e8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.060544 Aug 24 07:52:40.408593 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 507/1020] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Aug 24 07:52:40 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:52:40.458681 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:40.459506 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:40.463812 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-9c3e831c-4a84-4505-82cd-b54c39476b7a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-747575348", "imageRef": "3b02c0b2-d54a-48e3-aaa9-33529ce49b41", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-200319513", "networks": [{"uuid": "acd60a3a-b65b-40fa-98b0-546da80f5d05"}]}} {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:52:40.519535 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.network.neutron [None req-9c3e831c-4a84-4505-82cd-b54c39476b7a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] validate_networks() for [('acd60a3a-b65b-40fa-98b0-546da80f5d05', None, None, None, None, None)] {{(pid=127114) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 07:52:41.014082 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-9c3e831c-4a84-4505-82cd-b54c39476b7a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Flavor limits 0:0:0 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 07:52:41.014503 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-9c3e831c-4a84-4505-82cd-b54c39476b7a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Image limits 0:0:0 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 07:52:41.015005 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-9c3e831c-4a84-4505-82cd-b54c39476b7a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Flavor pref 0:0:0 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 07:52:41.015411 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-9c3e831c-4a84-4505-82cd-b54c39476b7a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Image pref 0:0:0 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 07:52:41.015810 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.virt.hardware [None req-9c3e831c-4a84-4505-82cd-b54c39476b7a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 07:52:41.026026 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9c3e831c-4a84-4505-82cd-b54c39476b7a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:41.026514 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9c3e831c-4a84-4505-82cd-b54c39476b7a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:41.026964 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9c3e831c-4a84-4505-82cd-b54c39476b7a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:41.027705 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9c3e831c-4a84-4505-82cd-b54c39476b7a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:41.028151 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9c3e831c-4a84-4505-82cd-b54c39476b7a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:41.028840 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9c3e831c-4a84-4505-82cd-b54c39476b7a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:41.046163 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.quota [None req-9c3e831c-4a84-4505-82cd-b54c39476b7a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Getting quotas for project f6a8a466e6a44ceb989ba40e429c625e. Resources: {'cores', 'ram', 'instances'} {{(pid=127114) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:52:41.050398 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.quota [None req-9c3e831c-4a84-4505-82cd-b54c39476b7a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Getting quotas for user 48f23faea87840ecbf5b75753eb1d139 and project f6a8a466e6a44ceb989ba40e429c625e. Resources: {'cores', 'ram', 'instances'} {{(pid=127114) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:52:41.073935 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-9c3e831c-4a84-4505-82cd-b54c39476b7a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Going to run 1 instances... {{(pid=127114) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 07:52:41.076874 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-9c3e831c-4a84-4505-82cd-b54c39476b7a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3b02c0b2-d54a-48e3-aaa9-33529ce49b41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127114) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 07:52:41.129377 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-9c3e831c-4a84-4505-82cd-b54c39476b7a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.672469 Aug 24 07:52:41.130282 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 514/1021] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Aug 24 07:52:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 07:52:41.141315 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-f5c7e516-a864-4566-8fed-0cdd70636130 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:41.142022 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-f5c7e516-a864-4566-8fed-0cdd70636130 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:41.207946 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-f5c7e516-a864-4566-8fed-0cdd70636130 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:41.218573 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-f5c7e516-a864-4566-8fed-0cdd70636130 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1257 microversion: 2.1 time: 0.081106 Aug 24 07:52:41.219278 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 508/1022] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:41 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1257 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:42.241442 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-7b580bba-24cf-4e2c-b0bd-41619de8773a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:42.242053 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-7b580bba-24cf-4e2c-b0bd-41619de8773a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:42.252069 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7b580bba-24cf-4e2c-b0bd-41619de8773a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:42.252567 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7b580bba-24cf-4e2c-b0bd-41619de8773a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:42.253004 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7b580bba-24cf-4e2c-b0bd-41619de8773a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:42.253714 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7b580bba-24cf-4e2c-b0bd-41619de8773a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:42.254168 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7b580bba-24cf-4e2c-b0bd-41619de8773a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:42.254593 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7b580bba-24cf-4e2c-b0bd-41619de8773a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:42.321738 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-7b580bba-24cf-4e2c-b0bd-41619de8773a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:42.329829 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-7b580bba-24cf-4e2c-b0bd-41619de8773a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.092312 Aug 24 07:52:42.330482 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 515/1023] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:42 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:43.351263 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-be6ed523-4295-4310-b569-540de7998653 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:43.351899 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-be6ed523-4295-4310-b569-540de7998653 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:43.358440 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-be6ed523-4295-4310-b569-540de7998653 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:43.358944 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-be6ed523-4295-4310-b569-540de7998653 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:43.359370 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-be6ed523-4295-4310-b569-540de7998653 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:43.360052 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-be6ed523-4295-4310-b569-540de7998653 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:43.360494 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-be6ed523-4295-4310-b569-540de7998653 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:43.360911 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-be6ed523-4295-4310-b569-540de7998653 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:43.423176 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-be6ed523-4295-4310-b569-540de7998653 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:43.431818 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-be6ed523-4295-4310-b569-540de7998653 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.084352 Aug 24 07:52:43.432378 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 509/1024] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:43 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:44.453094 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-b5a271f8-a92d-445a-8003-b294afcef488 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:44.453622 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-b5a271f8-a92d-445a-8003-b294afcef488 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:44.460467 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b5a271f8-a92d-445a-8003-b294afcef488 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:44.460943 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b5a271f8-a92d-445a-8003-b294afcef488 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:44.461377 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b5a271f8-a92d-445a-8003-b294afcef488 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:44.462073 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b5a271f8-a92d-445a-8003-b294afcef488 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:44.462525 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b5a271f8-a92d-445a-8003-b294afcef488 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:44.462971 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b5a271f8-a92d-445a-8003-b294afcef488 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:44.546335 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-b5a271f8-a92d-445a-8003-b294afcef488 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:44.555611 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-b5a271f8-a92d-445a-8003-b294afcef488 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.106443 Aug 24 07:52:44.556362 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 516/1025] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:44 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:45.586550 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-56b728fa-6ee7-4459-b7cb-0396694bd889 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:45.587780 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-56b728fa-6ee7-4459-b7cb-0396694bd889 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:45.599825 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-56b728fa-6ee7-4459-b7cb-0396694bd889 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:45.601109 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-56b728fa-6ee7-4459-b7cb-0396694bd889 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:45.601713 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-56b728fa-6ee7-4459-b7cb-0396694bd889 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:45.602484 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-56b728fa-6ee7-4459-b7cb-0396694bd889 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:45.603062 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-56b728fa-6ee7-4459-b7cb-0396694bd889 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:45.603495 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-56b728fa-6ee7-4459-b7cb-0396694bd889 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:45.690293 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-56b728fa-6ee7-4459-b7cb-0396694bd889 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:45.699188 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-56b728fa-6ee7-4459-b7cb-0396694bd889 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.121607 Aug 24 07:52:45.699936 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 510/1026] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:45 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:52:46.724781 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-1708ddf0-99c8-49a9-983a-9e239b8d0f31 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:46.726425 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-1708ddf0-99c8-49a9-983a-9e239b8d0f31 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:46.737787 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1708ddf0-99c8-49a9-983a-9e239b8d0f31 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:46.738656 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1708ddf0-99c8-49a9-983a-9e239b8d0f31 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:46.739466 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1708ddf0-99c8-49a9-983a-9e239b8d0f31 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:46.740693 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1708ddf0-99c8-49a9-983a-9e239b8d0f31 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:46.741505 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1708ddf0-99c8-49a9-983a-9e239b8d0f31 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:46.742257 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1708ddf0-99c8-49a9-983a-9e239b8d0f31 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:46.842076 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-1708ddf0-99c8-49a9-983a-9e239b8d0f31 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:46.856049 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-1708ddf0-99c8-49a9-983a-9e239b8d0f31 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.138172 Aug 24 07:52:46.857064 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 517/1027] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:46 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:47.888397 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-3386e383-a10c-451b-ad0e-4320d24cbe12 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:47.889009 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-3386e383-a10c-451b-ad0e-4320d24cbe12 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:47.895681 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3386e383-a10c-451b-ad0e-4320d24cbe12 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:47.896139 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3386e383-a10c-451b-ad0e-4320d24cbe12 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:47.896572 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3386e383-a10c-451b-ad0e-4320d24cbe12 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:47.897792 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3386e383-a10c-451b-ad0e-4320d24cbe12 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:47.898245 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3386e383-a10c-451b-ad0e-4320d24cbe12 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:47.898663 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3386e383-a10c-451b-ad0e-4320d24cbe12 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:47.982086 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-3386e383-a10c-451b-ad0e-4320d24cbe12 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:47.993566 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-3386e383-a10c-451b-ad0e-4320d24cbe12 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.109102 Aug 24 07:52:47.994355 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 511/1028] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:47 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:49.017970 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-2615f703-e92f-4a96-83f6-d8a2680fe038 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:49.019107 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-2615f703-e92f-4a96-83f6-d8a2680fe038 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:49.044595 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2615f703-e92f-4a96-83f6-d8a2680fe038 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:49.045576 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2615f703-e92f-4a96-83f6-d8a2680fe038 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:49.046375 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2615f703-e92f-4a96-83f6-d8a2680fe038 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:49.047843 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2615f703-e92f-4a96-83f6-d8a2680fe038 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:49.048375 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2615f703-e92f-4a96-83f6-d8a2680fe038 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:49.049498 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2615f703-e92f-4a96-83f6-d8a2680fe038 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:49.152379 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-2615f703-e92f-4a96-83f6-d8a2680fe038 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:49.161087 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-2615f703-e92f-4a96-83f6-d8a2680fe038 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.148700 Aug 24 07:52:49.161724 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 518/1029] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:49 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:50.189238 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-d9024c83-e5f8-4a22-a7fc-5a42ab451179 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:50.190246 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-d9024c83-e5f8-4a22-a7fc-5a42ab451179 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:50.200998 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d9024c83-e5f8-4a22-a7fc-5a42ab451179 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:50.201772 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d9024c83-e5f8-4a22-a7fc-5a42ab451179 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:50.202442 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d9024c83-e5f8-4a22-a7fc-5a42ab451179 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:50.203581 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d9024c83-e5f8-4a22-a7fc-5a42ab451179 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:50.204285 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d9024c83-e5f8-4a22-a7fc-5a42ab451179 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:50.205279 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d9024c83-e5f8-4a22-a7fc-5a42ab451179 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:50.312430 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-d9024c83-e5f8-4a22-a7fc-5a42ab451179 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:50.325785 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-d9024c83-e5f8-4a22-a7fc-5a42ab451179 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.142651 Aug 24 07:52:50.326680 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 512/1030] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:50 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:51.361193 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-38b60a5c-44aa-4294-894d-efb1b9991e37 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:51.362301 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-38b60a5c-44aa-4294-894d-efb1b9991e37 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:51.366762 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell0:SELECT=2 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:51.367900 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell0:SELECT=6 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:51.378488 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-38b60a5c-44aa-4294-894d-efb1b9991e37 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:51.379591 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-38b60a5c-44aa-4294-894d-efb1b9991e37 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:51.380343 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-38b60a5c-44aa-4294-894d-efb1b9991e37 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:51.381716 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-38b60a5c-44aa-4294-894d-efb1b9991e37 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:51.382523 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-38b60a5c-44aa-4294-894d-efb1b9991e37 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:51.383305 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-38b60a5c-44aa-4294-894d-efb1b9991e37 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:51.496392 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-38b60a5c-44aa-4294-894d-efb1b9991e37 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:51.504897 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-38b60a5c-44aa-4294-894d-efb1b9991e37 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.151021 Aug 24 07:52:51.505530 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 519/1031] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:51 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:52.528422 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-e66860e8-3e4a-4343-abca-7bd7b2e20905 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:52.529537 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-e66860e8-3e4a-4343-abca-7bd7b2e20905 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:52.533611 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell0:SELECT=6 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:52.540735 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e66860e8-3e4a-4343-abca-7bd7b2e20905 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:52.541384 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e66860e8-3e4a-4343-abca-7bd7b2e20905 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:52.541826 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e66860e8-3e4a-4343-abca-7bd7b2e20905 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:52.542538 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e66860e8-3e4a-4343-abca-7bd7b2e20905 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:52.543028 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e66860e8-3e4a-4343-abca-7bd7b2e20905 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:52.543452 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e66860e8-3e4a-4343-abca-7bd7b2e20905 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:52.620341 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-e66860e8-3e4a-4343-abca-7bd7b2e20905 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:52.634487 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-e66860e8-3e4a-4343-abca-7bd7b2e20905 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.112011 Aug 24 07:52:52.635543 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 513/1032] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:52 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:53.669578 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-5f8bbdf8-111e-49c4-bd5b-f06f2cf2c0d6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:53.670684 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-5f8bbdf8-111e-49c4-bd5b-f06f2cf2c0d6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:53.682493 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5f8bbdf8-111e-49c4-bd5b-f06f2cf2c0d6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:53.683373 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5f8bbdf8-111e-49c4-bd5b-f06f2cf2c0d6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:53.684126 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5f8bbdf8-111e-49c4-bd5b-f06f2cf2c0d6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:53.685346 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5f8bbdf8-111e-49c4-bd5b-f06f2cf2c0d6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:53.686145 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5f8bbdf8-111e-49c4-bd5b-f06f2cf2c0d6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:53.686939 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5f8bbdf8-111e-49c4-bd5b-f06f2cf2c0d6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:53.779633 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-5f8bbdf8-111e-49c4-bd5b-f06f2cf2c0d6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:53.791810 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-5f8bbdf8-111e-49c4-bd5b-f06f2cf2c0d6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.128066 Aug 24 07:52:53.792515 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 520/1033] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:53 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:54.816966 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-bd84012c-6c07-4c92-bcf3-d35d20672813 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:54.817743 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-bd84012c-6c07-4c92-bcf3-d35d20672813 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:54.824656 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bd84012c-6c07-4c92-bcf3-d35d20672813 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:54.825238 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bd84012c-6c07-4c92-bcf3-d35d20672813 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:54.825719 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bd84012c-6c07-4c92-bcf3-d35d20672813 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:54.826554 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bd84012c-6c07-4c92-bcf3-d35d20672813 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:54.827112 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bd84012c-6c07-4c92-bcf3-d35d20672813 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:54.827578 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bd84012c-6c07-4c92-bcf3-d35d20672813 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:55.187401 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-bd84012c-6c07-4c92-bcf3-d35d20672813 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:55.199682 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-bd84012c-6c07-4c92-bcf3-d35d20672813 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.386269 Aug 24 07:52:55.200632 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 514/1034] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:54 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:52:56.232601 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-9325195c-9827-49f9-8525-9abb74744e3a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:56.233348 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-9325195c-9827-49f9-8525-9abb74744e3a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:56.245700 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9325195c-9827-49f9-8525-9abb74744e3a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:56.246564 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9325195c-9827-49f9-8525-9abb74744e3a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:56.247360 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9325195c-9827-49f9-8525-9abb74744e3a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:56.248585 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9325195c-9827-49f9-8525-9abb74744e3a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:56.249420 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9325195c-9827-49f9-8525-9abb74744e3a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:56.250169 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9325195c-9827-49f9-8525-9abb74744e3a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:56.353864 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-9325195c-9827-49f9-8525-9abb74744e3a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:56.367514 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-9325195c-9827-49f9-8525-9abb74744e3a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.140493 Aug 24 07:52:56.368514 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 521/1035] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:56 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:57.399890 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-d2354f64-dbe6-4380-9e7e-6c19cf2a95f5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:57.400572 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-d2354f64-dbe6-4380-9e7e-6c19cf2a95f5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:57.407097 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d2354f64-dbe6-4380-9e7e-6c19cf2a95f5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:57.407573 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d2354f64-dbe6-4380-9e7e-6c19cf2a95f5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:57.408005 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d2354f64-dbe6-4380-9e7e-6c19cf2a95f5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:57.408693 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d2354f64-dbe6-4380-9e7e-6c19cf2a95f5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:57.409149 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d2354f64-dbe6-4380-9e7e-6c19cf2a95f5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:57.409560 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d2354f64-dbe6-4380-9e7e-6c19cf2a95f5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:57.496613 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-d2354f64-dbe6-4380-9e7e-6c19cf2a95f5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:57.509527 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-d2354f64-dbe6-4380-9e7e-6c19cf2a95f5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.113105 Aug 24 07:52:57.510571 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 515/1036] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:57 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:52:58.545706 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-29e4c87a-270e-497e-9242-cfe877a2dfb9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:58.546623 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-29e4c87a-270e-497e-9242-cfe877a2dfb9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:58.557565 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-29e4c87a-270e-497e-9242-cfe877a2dfb9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:58.558420 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-29e4c87a-270e-497e-9242-cfe877a2dfb9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:58.559242 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-29e4c87a-270e-497e-9242-cfe877a2dfb9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:58.560499 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-29e4c87a-270e-497e-9242-cfe877a2dfb9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:58.561335 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-29e4c87a-270e-497e-9242-cfe877a2dfb9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:58.562096 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-29e4c87a-270e-497e-9242-cfe877a2dfb9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:58.661874 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-29e4c87a-270e-497e-9242-cfe877a2dfb9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:58.671213 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-29e4c87a-270e-497e-9242-cfe877a2dfb9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.131901 Aug 24 07:52:58.671998 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 522/1037] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:58 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:52:59.697393 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-42fe4810-9f7c-402d-8757-44be320be2b6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:52:59.698404 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-42fe4810-9f7c-402d-8757-44be320be2b6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:52:59.708670 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-42fe4810-9f7c-402d-8757-44be320be2b6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:59.709584 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-42fe4810-9f7c-402d-8757-44be320be2b6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:59.710275 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-42fe4810-9f7c-402d-8757-44be320be2b6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:59.711252 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-42fe4810-9f7c-402d-8757-44be320be2b6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:52:59.711720 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-42fe4810-9f7c-402d-8757-44be320be2b6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:52:59.712154 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-42fe4810-9f7c-402d-8757-44be320be2b6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:52:59.790531 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-42fe4810-9f7c-402d-8757-44be320be2b6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:52:59.805110 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-42fe4810-9f7c-402d-8757-44be320be2b6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.114986 Aug 24 07:52:59.806153 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 516/1038] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:52:59 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:00.841962 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-6b5199f0-d9fc-4e12-b6c3-8250ad83d2f2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:00.844305 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-6b5199f0-d9fc-4e12-b6c3-8250ad83d2f2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:00.856595 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6b5199f0-d9fc-4e12-b6c3-8250ad83d2f2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:00.857325 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6b5199f0-d9fc-4e12-b6c3-8250ad83d2f2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:00.857980 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6b5199f0-d9fc-4e12-b6c3-8250ad83d2f2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:00.859162 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6b5199f0-d9fc-4e12-b6c3-8250ad83d2f2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:00.860073 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6b5199f0-d9fc-4e12-b6c3-8250ad83d2f2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:00.861277 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6b5199f0-d9fc-4e12-b6c3-8250ad83d2f2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:00.970049 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-6b5199f0-d9fc-4e12-b6c3-8250ad83d2f2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:00.984361 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-6b5199f0-d9fc-4e12-b6c3-8250ad83d2f2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.150590 Aug 24 07:53:00.985405 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 523/1039] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:00 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:02.021636 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-7940568d-4af1-45a6-be05-c0bb31a364a2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:02.022684 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-7940568d-4af1-45a6-be05-c0bb31a364a2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:02.034243 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7940568d-4af1-45a6-be05-c0bb31a364a2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:02.035111 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7940568d-4af1-45a6-be05-c0bb31a364a2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:02.035866 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7940568d-4af1-45a6-be05-c0bb31a364a2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:02.037059 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7940568d-4af1-45a6-be05-c0bb31a364a2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:02.038346 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7940568d-4af1-45a6-be05-c0bb31a364a2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:02.039070 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7940568d-4af1-45a6-be05-c0bb31a364a2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:02.141781 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-7940568d-4af1-45a6-be05-c0bb31a364a2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:02.155367 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-7940568d-4af1-45a6-be05-c0bb31a364a2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.140457 Aug 24 07:53:02.156215 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 517/1040] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:02 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:03.199780 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-546d6573-3e6c-4017-aab2-31898f33a991 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:03.200663 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-546d6573-3e6c-4017-aab2-31898f33a991 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:03.212080 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-546d6573-3e6c-4017-aab2-31898f33a991 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:03.212924 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-546d6573-3e6c-4017-aab2-31898f33a991 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:03.213579 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-546d6573-3e6c-4017-aab2-31898f33a991 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:03.214582 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-546d6573-3e6c-4017-aab2-31898f33a991 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:03.215602 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-546d6573-3e6c-4017-aab2-31898f33a991 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:03.216360 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-546d6573-3e6c-4017-aab2-31898f33a991 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:03.289498 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-546d6573-3e6c-4017-aab2-31898f33a991 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:03.302771 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-546d6573-3e6c-4017-aab2-31898f33a991 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.109789 Aug 24 07:53:03.304396 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 524/1041] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:03 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:04.329141 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-f58dcb2f-ceff-4ee5-aa09-f4d1ceff7fc5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:04.330225 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-f58dcb2f-ceff-4ee5-aa09-f4d1ceff7fc5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:04.341076 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f58dcb2f-ceff-4ee5-aa09-f4d1ceff7fc5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:04.341916 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f58dcb2f-ceff-4ee5-aa09-f4d1ceff7fc5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:04.342661 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f58dcb2f-ceff-4ee5-aa09-f4d1ceff7fc5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:04.343835 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f58dcb2f-ceff-4ee5-aa09-f4d1ceff7fc5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:04.344589 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f58dcb2f-ceff-4ee5-aa09-f4d1ceff7fc5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:04.345290 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f58dcb2f-ceff-4ee5-aa09-f4d1ceff7fc5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:04.452821 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-f58dcb2f-ceff-4ee5-aa09-f4d1ceff7fc5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:04.466941 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-f58dcb2f-ceff-4ee5-aa09-f4d1ceff7fc5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.144447 Aug 24 07:53:04.467926 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 518/1042] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:04 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:53:05.494932 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-75f68168-7cf8-47a0-b0d2-49222b3ba7e8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:05.495594 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-75f68168-7cf8-47a0-b0d2-49222b3ba7e8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:05.507443 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-75f68168-7cf8-47a0-b0d2-49222b3ba7e8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:05.508138 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-75f68168-7cf8-47a0-b0d2-49222b3ba7e8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:05.508786 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-75f68168-7cf8-47a0-b0d2-49222b3ba7e8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:05.509759 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-75f68168-7cf8-47a0-b0d2-49222b3ba7e8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:05.510216 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-75f68168-7cf8-47a0-b0d2-49222b3ba7e8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:05.510686 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-75f68168-7cf8-47a0-b0d2-49222b3ba7e8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:05.581494 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-75f68168-7cf8-47a0-b0d2-49222b3ba7e8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:05.590904 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-75f68168-7cf8-47a0-b0d2-49222b3ba7e8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.100599 Aug 24 07:53:05.592189 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 525/1043] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:05 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:53:06.613252 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-85c313d7-8e30-4854-993d-e9aff3c6c4ce tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:06.614104 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-85c313d7-8e30-4854-993d-e9aff3c6c4ce tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:06.621459 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-85c313d7-8e30-4854-993d-e9aff3c6c4ce tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:06.621938 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-85c313d7-8e30-4854-993d-e9aff3c6c4ce tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:06.622368 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-85c313d7-8e30-4854-993d-e9aff3c6c4ce tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:06.623098 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-85c313d7-8e30-4854-993d-e9aff3c6c4ce tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:06.623554 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-85c313d7-8e30-4854-993d-e9aff3c6c4ce tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:06.623972 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-85c313d7-8e30-4854-993d-e9aff3c6c4ce tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:06.702190 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-85c313d7-8e30-4854-993d-e9aff3c6c4ce tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:06.713106 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-85c313d7-8e30-4854-993d-e9aff3c6c4ce tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.103950 Aug 24 07:53:06.713677 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 519/1044] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:06 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:07.738889 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-15db32b4-2c8a-438b-81c0-c9f4ecf87ad9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:07.739480 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-15db32b4-2c8a-438b-81c0-c9f4ecf87ad9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:07.747525 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-15db32b4-2c8a-438b-81c0-c9f4ecf87ad9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:07.748060 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-15db32b4-2c8a-438b-81c0-c9f4ecf87ad9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:07.748551 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-15db32b4-2c8a-438b-81c0-c9f4ecf87ad9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:07.749336 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-15db32b4-2c8a-438b-81c0-c9f4ecf87ad9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:07.749842 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-15db32b4-2c8a-438b-81c0-c9f4ecf87ad9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:07.750302 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-15db32b4-2c8a-438b-81c0-c9f4ecf87ad9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:07.837287 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-15db32b4-2c8a-438b-81c0-c9f4ecf87ad9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:07.845492 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-15db32b4-2c8a-438b-81c0-c9f4ecf87ad9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.110505 Aug 24 07:53:07.846125 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 526/1045] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:07 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:08.871003 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-0938ae91-27d7-4ed4-a9bf-25df3e2df313 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:08.872241 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-0938ae91-27d7-4ed4-a9bf-25df3e2df313 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:08.880098 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0938ae91-27d7-4ed4-a9bf-25df3e2df313 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:08.880591 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0938ae91-27d7-4ed4-a9bf-25df3e2df313 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:08.881025 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0938ae91-27d7-4ed4-a9bf-25df3e2df313 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:08.882307 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0938ae91-27d7-4ed4-a9bf-25df3e2df313 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:08.883397 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0938ae91-27d7-4ed4-a9bf-25df3e2df313 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:08.883832 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0938ae91-27d7-4ed4-a9bf-25df3e2df313 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:08.961175 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-0938ae91-27d7-4ed4-a9bf-25df3e2df313 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:08.969615 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-0938ae91-27d7-4ed4-a9bf-25df3e2df313 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.105288 Aug 24 07:53:08.970389 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 520/1046] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:08 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:09.994011 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-ce199304-f8a5-4b08-99f3-bebd66f52fca tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:09.995090 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-ce199304-f8a5-4b08-99f3-bebd66f52fca tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:10.005846 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ce199304-f8a5-4b08-99f3-bebd66f52fca tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:10.007205 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ce199304-f8a5-4b08-99f3-bebd66f52fca tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:10.007962 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ce199304-f8a5-4b08-99f3-bebd66f52fca tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:10.009147 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ce199304-f8a5-4b08-99f3-bebd66f52fca tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:10.009956 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ce199304-f8a5-4b08-99f3-bebd66f52fca tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:10.010718 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ce199304-f8a5-4b08-99f3-bebd66f52fca tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:10.096675 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-ce199304-f8a5-4b08-99f3-bebd66f52fca tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:10.105897 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-ce199304-f8a5-4b08-99f3-bebd66f52fca tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.118379 Aug 24 07:53:10.106942 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 527/1047] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:09 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:11.131567 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-3e7faf72-d3f7-492c-82ec-deb5a521426d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:11.132606 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-3e7faf72-d3f7-492c-82ec-deb5a521426d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:11.136547 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:11.146345 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3e7faf72-d3f7-492c-82ec-deb5a521426d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:11.147678 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3e7faf72-d3f7-492c-82ec-deb5a521426d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:11.148427 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3e7faf72-d3f7-492c-82ec-deb5a521426d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:11.149132 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3e7faf72-d3f7-492c-82ec-deb5a521426d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:11.149584 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3e7faf72-d3f7-492c-82ec-deb5a521426d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:11.150019 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3e7faf72-d3f7-492c-82ec-deb5a521426d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:11.153341 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell1:SELECT=73 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:11.236082 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-3e7faf72-d3f7-492c-82ec-deb5a521426d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:11.248969 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-3e7faf72-d3f7-492c-82ec-deb5a521426d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.124687 Aug 24 07:53:11.250123 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 521/1048] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:11 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:12.273707 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-09623bc2-102f-4fdd-88a3-b57f02ebbea5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:12.274823 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-09623bc2-102f-4fdd-88a3-b57f02ebbea5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:12.278329 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:12.287680 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-09623bc2-102f-4fdd-88a3-b57f02ebbea5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:12.288460 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-09623bc2-102f-4fdd-88a3-b57f02ebbea5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:12.289162 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-09623bc2-102f-4fdd-88a3-b57f02ebbea5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:12.290206 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-09623bc2-102f-4fdd-88a3-b57f02ebbea5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:12.290796 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-09623bc2-102f-4fdd-88a3-b57f02ebbea5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:12.291349 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-09623bc2-102f-4fdd-88a3-b57f02ebbea5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:12.295462 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell1:SELECT=81 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:12.368009 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-09623bc2-102f-4fdd-88a3-b57f02ebbea5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:12.375908 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-09623bc2-102f-4fdd-88a3-b57f02ebbea5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.107819 Aug 24 07:53:12.376480 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 528/1049] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:12 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:13.404083 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-17c45f2c-6c35-4763-9c53-00789c32858c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:13.404683 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-17c45f2c-6c35-4763-9c53-00789c32858c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:13.411887 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-17c45f2c-6c35-4763-9c53-00789c32858c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:13.412379 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-17c45f2c-6c35-4763-9c53-00789c32858c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:13.412862 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-17c45f2c-6c35-4763-9c53-00789c32858c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:13.413555 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-17c45f2c-6c35-4763-9c53-00789c32858c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:13.414002 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-17c45f2c-6c35-4763-9c53-00789c32858c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:13.414417 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-17c45f2c-6c35-4763-9c53-00789c32858c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:13.485094 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-17c45f2c-6c35-4763-9c53-00789c32858c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:13.493907 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-17c45f2c-6c35-4763-9c53-00789c32858c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.093771 Aug 24 07:53:13.494498 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 522/1050] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:13 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:14.519911 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-d81db4e0-e391-4998-b04b-5d9a391fc3ac tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:14.520876 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-d81db4e0-e391-4998-b04b-5d9a391fc3ac tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:14.531410 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d81db4e0-e391-4998-b04b-5d9a391fc3ac tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:14.532137 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d81db4e0-e391-4998-b04b-5d9a391fc3ac tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:14.532782 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d81db4e0-e391-4998-b04b-5d9a391fc3ac tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:14.533692 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d81db4e0-e391-4998-b04b-5d9a391fc3ac tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:14.534367 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d81db4e0-e391-4998-b04b-5d9a391fc3ac tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:14.534925 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d81db4e0-e391-4998-b04b-5d9a391fc3ac tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:14.625354 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-d81db4e0-e391-4998-b04b-5d9a391fc3ac tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:14.637437 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-d81db4e0-e391-4998-b04b-5d9a391fc3ac tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.124933 Aug 24 07:53:14.638051 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 529/1051] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:14 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:15.658163 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-a9205ccd-0169-423b-8c57-3af8f485d47b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:15.658778 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-a9205ccd-0169-423b-8c57-3af8f485d47b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:15.666924 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a9205ccd-0169-423b-8c57-3af8f485d47b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:15.667804 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a9205ccd-0169-423b-8c57-3af8f485d47b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:15.668440 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a9205ccd-0169-423b-8c57-3af8f485d47b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:15.669528 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a9205ccd-0169-423b-8c57-3af8f485d47b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:15.670291 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a9205ccd-0169-423b-8c57-3af8f485d47b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:15.671043 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a9205ccd-0169-423b-8c57-3af8f485d47b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:15.751509 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-a9205ccd-0169-423b-8c57-3af8f485d47b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:15.763209 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-a9205ccd-0169-423b-8c57-3af8f485d47b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.108582 Aug 24 07:53:15.763970 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 523/1052] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:15 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:16.790643 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-0a5ec71e-d840-4870-b779-ad5c48a9523c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:16.791333 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-0a5ec71e-d840-4870-b779-ad5c48a9523c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:16.799910 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0a5ec71e-d840-4870-b779-ad5c48a9523c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:16.800398 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0a5ec71e-d840-4870-b779-ad5c48a9523c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:16.800835 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0a5ec71e-d840-4870-b779-ad5c48a9523c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:16.801581 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0a5ec71e-d840-4870-b779-ad5c48a9523c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:16.802047 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0a5ec71e-d840-4870-b779-ad5c48a9523c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:16.802473 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0a5ec71e-d840-4870-b779-ad5c48a9523c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:16.875084 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-0a5ec71e-d840-4870-b779-ad5c48a9523c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:16.883664 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-0a5ec71e-d840-4870-b779-ad5c48a9523c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.098669 Aug 24 07:53:16.884249 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 530/1053] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:16 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:53:17.912159 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-f675bfe7-0032-4a23-ba80-b0d9dab85b98 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:17.912999 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-f675bfe7-0032-4a23-ba80-b0d9dab85b98 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:17.920733 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f675bfe7-0032-4a23-ba80-b0d9dab85b98 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:17.921216 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f675bfe7-0032-4a23-ba80-b0d9dab85b98 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:17.921649 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f675bfe7-0032-4a23-ba80-b0d9dab85b98 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:17.922349 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f675bfe7-0032-4a23-ba80-b0d9dab85b98 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:17.922835 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f675bfe7-0032-4a23-ba80-b0d9dab85b98 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:17.923268 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f675bfe7-0032-4a23-ba80-b0d9dab85b98 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:17.989770 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-f675bfe7-0032-4a23-ba80-b0d9dab85b98 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:17.997575 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-f675bfe7-0032-4a23-ba80-b0d9dab85b98 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.091530 Aug 24 07:53:17.998141 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 524/1054] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:17 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:19.022974 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-e5a2d666-ab0e-4c96-ab54-c182b5942f0e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:19.024415 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-e5a2d666-ab0e-4c96-ab54-c182b5942f0e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:19.034390 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e5a2d666-ab0e-4c96-ab54-c182b5942f0e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:19.035196 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e5a2d666-ab0e-4c96-ab54-c182b5942f0e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:19.035846 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e5a2d666-ab0e-4c96-ab54-c182b5942f0e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:19.036898 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e5a2d666-ab0e-4c96-ab54-c182b5942f0e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:19.037442 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e5a2d666-ab0e-4c96-ab54-c182b5942f0e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:19.038124 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e5a2d666-ab0e-4c96-ab54-c182b5942f0e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:19.119272 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-e5a2d666-ab0e-4c96-ab54-c182b5942f0e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:19.133202 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-e5a2d666-ab0e-4c96-ab54-c182b5942f0e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.117609 Aug 24 07:53:19.134161 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 531/1055] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:19 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:20.167325 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-a2038047-b56a-4530-942c-438997be35c9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:20.168085 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-a2038047-b56a-4530-942c-438997be35c9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:20.177047 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a2038047-b56a-4530-942c-438997be35c9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:20.177836 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a2038047-b56a-4530-942c-438997be35c9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:20.178625 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a2038047-b56a-4530-942c-438997be35c9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:20.179829 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a2038047-b56a-4530-942c-438997be35c9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:20.180486 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a2038047-b56a-4530-942c-438997be35c9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:20.181076 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a2038047-b56a-4530-942c-438997be35c9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:20.265528 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-a2038047-b56a-4530-942c-438997be35c9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:20.276027 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-a2038047-b56a-4530-942c-438997be35c9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.114765 Aug 24 07:53:20.276633 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 525/1056] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:20 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:21.298011 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-096014ac-ecf5-4fc4-a9bc-44eb89706922 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:21.298608 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-096014ac-ecf5-4fc4-a9bc-44eb89706922 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:21.306374 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-096014ac-ecf5-4fc4-a9bc-44eb89706922 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:21.306899 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-096014ac-ecf5-4fc4-a9bc-44eb89706922 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:21.307337 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-096014ac-ecf5-4fc4-a9bc-44eb89706922 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:21.308041 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-096014ac-ecf5-4fc4-a9bc-44eb89706922 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:21.308494 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-096014ac-ecf5-4fc4-a9bc-44eb89706922 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:21.308914 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-096014ac-ecf5-4fc4-a9bc-44eb89706922 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:21.390920 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-096014ac-ecf5-4fc4-a9bc-44eb89706922 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:21.399957 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-096014ac-ecf5-4fc4-a9bc-44eb89706922 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.106140 Aug 24 07:53:21.400540 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 532/1057] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:21 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:22.422087 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-f7a685ff-90df-426c-af6f-ddcf35dfb0c3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:22.422807 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-f7a685ff-90df-426c-af6f-ddcf35dfb0c3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:22.430448 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f7a685ff-90df-426c-af6f-ddcf35dfb0c3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:22.431146 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f7a685ff-90df-426c-af6f-ddcf35dfb0c3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:22.431901 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f7a685ff-90df-426c-af6f-ddcf35dfb0c3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:22.433117 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f7a685ff-90df-426c-af6f-ddcf35dfb0c3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:22.433887 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f7a685ff-90df-426c-af6f-ddcf35dfb0c3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:22.434625 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f7a685ff-90df-426c-af6f-ddcf35dfb0c3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:22.507445 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-f7a685ff-90df-426c-af6f-ddcf35dfb0c3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:22.520550 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-f7a685ff-90df-426c-af6f-ddcf35dfb0c3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.102251 Aug 24 07:53:22.521514 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 526/1058] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:22 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:23.543069 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-79a5510d-ccf1-45dc-a010-aa0764bf86d6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:23.543687 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-79a5510d-ccf1-45dc-a010-aa0764bf86d6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:23.550814 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-79a5510d-ccf1-45dc-a010-aa0764bf86d6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:23.551303 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-79a5510d-ccf1-45dc-a010-aa0764bf86d6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:23.551738 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-79a5510d-ccf1-45dc-a010-aa0764bf86d6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:23.552440 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-79a5510d-ccf1-45dc-a010-aa0764bf86d6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:23.552887 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-79a5510d-ccf1-45dc-a010-aa0764bf86d6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:23.553865 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-79a5510d-ccf1-45dc-a010-aa0764bf86d6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:23.617523 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-79a5510d-ccf1-45dc-a010-aa0764bf86d6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:23.625981 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-79a5510d-ccf1-45dc-a010-aa0764bf86d6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.086764 Aug 24 07:53:23.626568 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 533/1059] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:23 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:24.646450 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-6c34dc3b-4061-496b-8882-b87c9ac32b7c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:24.647592 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-6c34dc3b-4061-496b-8882-b87c9ac32b7c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:24.655553 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6c34dc3b-4061-496b-8882-b87c9ac32b7c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:24.656038 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6c34dc3b-4061-496b-8882-b87c9ac32b7c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:24.656464 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6c34dc3b-4061-496b-8882-b87c9ac32b7c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:24.657203 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6c34dc3b-4061-496b-8882-b87c9ac32b7c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:24.657622 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6c34dc3b-4061-496b-8882-b87c9ac32b7c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:24.658036 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6c34dc3b-4061-496b-8882-b87c9ac32b7c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:24.721350 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-6c34dc3b-4061-496b-8882-b87c9ac32b7c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:24.729985 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-6c34dc3b-4061-496b-8882-b87c9ac32b7c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.087317 Aug 24 07:53:24.730569 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 527/1060] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:24 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:25.754018 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-d3267ac8-9f0c-4146-a3af-3c8ce8bf8f5c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:25.754904 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-d3267ac8-9f0c-4146-a3af-3c8ce8bf8f5c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:25.766296 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d3267ac8-9f0c-4146-a3af-3c8ce8bf8f5c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:25.767142 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d3267ac8-9f0c-4146-a3af-3c8ce8bf8f5c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:25.767809 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d3267ac8-9f0c-4146-a3af-3c8ce8bf8f5c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:25.768868 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d3267ac8-9f0c-4146-a3af-3c8ce8bf8f5c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:25.769330 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d3267ac8-9f0c-4146-a3af-3c8ce8bf8f5c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:25.769752 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d3267ac8-9f0c-4146-a3af-3c8ce8bf8f5c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:25.839428 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-d3267ac8-9f0c-4146-a3af-3c8ce8bf8f5c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:25.853322 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-d3267ac8-9f0c-4146-a3af-3c8ce8bf8f5c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.105371 Aug 24 07:53:25.854321 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 534/1061] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:25 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:26.888985 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-f1526800-e126-4c01-b708-a587dbb43b4c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:26.889632 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-f1526800-e126-4c01-b708-a587dbb43b4c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:26.896837 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f1526800-e126-4c01-b708-a587dbb43b4c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:26.897342 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f1526800-e126-4c01-b708-a587dbb43b4c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:26.897825 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f1526800-e126-4c01-b708-a587dbb43b4c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:26.898586 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f1526800-e126-4c01-b708-a587dbb43b4c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:26.899090 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f1526800-e126-4c01-b708-a587dbb43b4c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:26.899518 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f1526800-e126-4c01-b708-a587dbb43b4c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:26.965730 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-f1526800-e126-4c01-b708-a587dbb43b4c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:26.973883 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-f1526800-e126-4c01-b708-a587dbb43b4c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.089670 Aug 24 07:53:26.974460 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 528/1062] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:26 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:27.995081 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-abd73225-1637-4b09-a7fd-5126a691d11d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:27.995684 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-abd73225-1637-4b09-a7fd-5126a691d11d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:28.001682 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-abd73225-1637-4b09-a7fd-5126a691d11d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:28.002165 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-abd73225-1637-4b09-a7fd-5126a691d11d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:28.002593 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-abd73225-1637-4b09-a7fd-5126a691d11d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:28.003722 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-abd73225-1637-4b09-a7fd-5126a691d11d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:28.004271 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-abd73225-1637-4b09-a7fd-5126a691d11d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:28.004856 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-abd73225-1637-4b09-a7fd-5126a691d11d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:28.072304 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-abd73225-1637-4b09-a7fd-5126a691d11d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:28.080269 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-abd73225-1637-4b09-a7fd-5126a691d11d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.089506 Aug 24 07:53:28.080836 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 535/1063] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:27 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:29.101998 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-0a58a671-62cb-4ed9-b685-711747f31c62 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:29.102589 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-0a58a671-62cb-4ed9-b685-711747f31c62 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:29.109414 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0a58a671-62cb-4ed9-b685-711747f31c62 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:29.109901 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0a58a671-62cb-4ed9-b685-711747f31c62 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:29.110336 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0a58a671-62cb-4ed9-b685-711747f31c62 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:29.111259 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0a58a671-62cb-4ed9-b685-711747f31c62 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:29.111739 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0a58a671-62cb-4ed9-b685-711747f31c62 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:29.112162 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0a58a671-62cb-4ed9-b685-711747f31c62 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:29.194497 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-0a58a671-62cb-4ed9-b685-711747f31c62 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:29.202638 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-0a58a671-62cb-4ed9-b685-711747f31c62 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.105285 Aug 24 07:53:29.203275 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 529/1064] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:29 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:30.223392 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-03de5b34-be1b-40dd-889f-7209a964085c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:30.224327 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-03de5b34-be1b-40dd-889f-7209a964085c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:30.231143 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-03de5b34-be1b-40dd-889f-7209a964085c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:30.231627 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-03de5b34-be1b-40dd-889f-7209a964085c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:30.232089 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-03de5b34-be1b-40dd-889f-7209a964085c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:30.232785 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-03de5b34-be1b-40dd-889f-7209a964085c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:30.233238 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-03de5b34-be1b-40dd-889f-7209a964085c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:30.233659 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-03de5b34-be1b-40dd-889f-7209a964085c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:30.309745 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-03de5b34-be1b-40dd-889f-7209a964085c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:30.328687 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-03de5b34-be1b-40dd-889f-7209a964085c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.108934 Aug 24 07:53:30.329294 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 536/1065] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:30 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:31.365050 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-0d0ebffb-b842-423f-8ef9-b1c4bf383eaa tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:31.366018 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-0d0ebffb-b842-423f-8ef9-b1c4bf383eaa tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:31.373019 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0d0ebffb-b842-423f-8ef9-b1c4bf383eaa tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:31.373507 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0d0ebffb-b842-423f-8ef9-b1c4bf383eaa tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:31.373944 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0d0ebffb-b842-423f-8ef9-b1c4bf383eaa tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:31.374654 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0d0ebffb-b842-423f-8ef9-b1c4bf383eaa tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:31.375222 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0d0ebffb-b842-423f-8ef9-b1c4bf383eaa tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:31.375646 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0d0ebffb-b842-423f-8ef9-b1c4bf383eaa tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:31.452904 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-0d0ebffb-b842-423f-8ef9-b1c4bf383eaa tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:31.462526 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-0d0ebffb-b842-423f-8ef9-b1c4bf383eaa tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.104662 Aug 24 07:53:31.463124 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 530/1066] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:31 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:32.483223 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-217ed957-339c-4485-b563-6e68c4565bf3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:32.483882 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-217ed957-339c-4485-b563-6e68c4565bf3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:32.490385 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-217ed957-339c-4485-b563-6e68c4565bf3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:32.490907 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-217ed957-339c-4485-b563-6e68c4565bf3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:32.491874 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-217ed957-339c-4485-b563-6e68c4565bf3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:32.492573 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-217ed957-339c-4485-b563-6e68c4565bf3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:32.493019 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-217ed957-339c-4485-b563-6e68c4565bf3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:32.493432 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-217ed957-339c-4485-b563-6e68c4565bf3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:32.559499 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-217ed957-339c-4485-b563-6e68c4565bf3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:32.567809 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-217ed957-339c-4485-b563-6e68c4565bf3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.088652 Aug 24 07:53:32.568391 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 537/1067] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:32 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:33.590806 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-77a4eaa7-1100-4ec2-a19e-ca515a7cb2fe tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:33.591428 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-77a4eaa7-1100-4ec2-a19e-ca515a7cb2fe tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:33.598769 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-77a4eaa7-1100-4ec2-a19e-ca515a7cb2fe tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:33.599290 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-77a4eaa7-1100-4ec2-a19e-ca515a7cb2fe tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:33.599739 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-77a4eaa7-1100-4ec2-a19e-ca515a7cb2fe tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:33.600889 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-77a4eaa7-1100-4ec2-a19e-ca515a7cb2fe tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:33.601481 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-77a4eaa7-1100-4ec2-a19e-ca515a7cb2fe tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:33.602031 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-77a4eaa7-1100-4ec2-a19e-ca515a7cb2fe tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:33.679702 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-77a4eaa7-1100-4ec2-a19e-ca515a7cb2fe tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:33.688715 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-77a4eaa7-1100-4ec2-a19e-ca515a7cb2fe tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.103263 Aug 24 07:53:33.689465 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 531/1068] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:33 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:34.713282 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-df701a76-b312-4893-acc7-902284499028 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:34.714138 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-df701a76-b312-4893-acc7-902284499028 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:34.721450 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-df701a76-b312-4893-acc7-902284499028 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:34.721933 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-df701a76-b312-4893-acc7-902284499028 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:34.722374 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-df701a76-b312-4893-acc7-902284499028 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:34.723126 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-df701a76-b312-4893-acc7-902284499028 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:34.723630 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-df701a76-b312-4893-acc7-902284499028 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:34.724058 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-df701a76-b312-4893-acc7-902284499028 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:34.801370 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-df701a76-b312-4893-acc7-902284499028 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:34.818099 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-df701a76-b312-4893-acc7-902284499028 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.111102 Aug 24 07:53:34.818879 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 538/1069] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:34 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:35.839808 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-7e0f7156-8020-4b6b-abe5-80a9609ce6bf tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:35.840370 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-7e0f7156-8020-4b6b-abe5-80a9609ce6bf tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:35.846883 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7e0f7156-8020-4b6b-abe5-80a9609ce6bf tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:35.847368 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7e0f7156-8020-4b6b-abe5-80a9609ce6bf tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:35.847811 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7e0f7156-8020-4b6b-abe5-80a9609ce6bf tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:35.848507 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7e0f7156-8020-4b6b-abe5-80a9609ce6bf tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:35.848955 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7e0f7156-8020-4b6b-abe5-80a9609ce6bf tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:35.849371 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7e0f7156-8020-4b6b-abe5-80a9609ce6bf tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:35.913666 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-7e0f7156-8020-4b6b-abe5-80a9609ce6bf tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:35.921880 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-7e0f7156-8020-4b6b-abe5-80a9609ce6bf tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.086007 Aug 24 07:53:35.922458 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 532/1070] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:35 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:36.947272 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-a25e41f7-81e9-45e5-bea4-3ddabcdae450 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:36.947901 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-a25e41f7-81e9-45e5-bea4-3ddabcdae450 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:36.954529 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a25e41f7-81e9-45e5-bea4-3ddabcdae450 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:36.955039 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a25e41f7-81e9-45e5-bea4-3ddabcdae450 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:36.955475 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a25e41f7-81e9-45e5-bea4-3ddabcdae450 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:36.956170 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a25e41f7-81e9-45e5-bea4-3ddabcdae450 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:36.956619 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a25e41f7-81e9-45e5-bea4-3ddabcdae450 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:36.957039 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a25e41f7-81e9-45e5-bea4-3ddabcdae450 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:37.031863 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-a25e41f7-81e9-45e5-bea4-3ddabcdae450 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:37.048627 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-a25e41f7-81e9-45e5-bea4-3ddabcdae450 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.106079 Aug 24 07:53:37.049463 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 539/1071] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:36 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:38.078727 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-a486111d-5291-4ac4-9d8b-e3aa0a2b0873 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:38.081092 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-a486111d-5291-4ac4-9d8b-e3aa0a2b0873 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:38.086207 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a486111d-5291-4ac4-9d8b-e3aa0a2b0873 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:38.086708 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a486111d-5291-4ac4-9d8b-e3aa0a2b0873 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:38.087154 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a486111d-5291-4ac4-9d8b-e3aa0a2b0873 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:38.087854 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a486111d-5291-4ac4-9d8b-e3aa0a2b0873 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:38.088312 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a486111d-5291-4ac4-9d8b-e3aa0a2b0873 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:38.088735 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a486111d-5291-4ac4-9d8b-e3aa0a2b0873 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:38.152465 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-a486111d-5291-4ac4-9d8b-e3aa0a2b0873 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:38.160516 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-a486111d-5291-4ac4-9d8b-e3aa0a2b0873 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.085746 Aug 24 07:53:38.161065 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 533/1072] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:38 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:39.193212 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-50c28bd2-f1cf-4546-bb44-f045140103fb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:39.193855 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-50c28bd2-f1cf-4546-bb44-f045140103fb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:39.201373 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-50c28bd2-f1cf-4546-bb44-f045140103fb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:39.201858 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-50c28bd2-f1cf-4546-bb44-f045140103fb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:39.202296 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-50c28bd2-f1cf-4546-bb44-f045140103fb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:39.203170 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-50c28bd2-f1cf-4546-bb44-f045140103fb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:39.203632 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-50c28bd2-f1cf-4546-bb44-f045140103fb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:39.204062 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-50c28bd2-f1cf-4546-bb44-f045140103fb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:39.274449 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-50c28bd2-f1cf-4546-bb44-f045140103fb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:39.283210 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-50c28bd2-f1cf-4546-bb44-f045140103fb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.093829 Aug 24 07:53:39.284004 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 540/1073] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:39 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:40.308477 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-7247a095-a9e8-4c95-b90f-af6ad714ce3e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:40.309126 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-7247a095-a9e8-4c95-b90f-af6ad714ce3e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:40.315784 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7247a095-a9e8-4c95-b90f-af6ad714ce3e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:40.316265 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7247a095-a9e8-4c95-b90f-af6ad714ce3e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:40.316709 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7247a095-a9e8-4c95-b90f-af6ad714ce3e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:40.317411 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7247a095-a9e8-4c95-b90f-af6ad714ce3e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:40.317862 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7247a095-a9e8-4c95-b90f-af6ad714ce3e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:40.318284 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7247a095-a9e8-4c95-b90f-af6ad714ce3e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:40.390722 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-7247a095-a9e8-4c95-b90f-af6ad714ce3e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:40.399054 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-7247a095-a9e8-4c95-b90f-af6ad714ce3e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.095934 Aug 24 07:53:40.399637 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 534/1074] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:40 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:41.419938 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-3e773e26-d6eb-4727-90d9-be42b7e5d180 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:41.420546 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-3e773e26-d6eb-4727-90d9-be42b7e5d180 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:41.430636 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3e773e26-d6eb-4727-90d9-be42b7e5d180 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:41.431533 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3e773e26-d6eb-4727-90d9-be42b7e5d180 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:41.432320 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3e773e26-d6eb-4727-90d9-be42b7e5d180 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:41.433581 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3e773e26-d6eb-4727-90d9-be42b7e5d180 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:41.434405 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3e773e26-d6eb-4727-90d9-be42b7e5d180 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:41.435216 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3e773e26-d6eb-4727-90d9-be42b7e5d180 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:41.533617 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-3e773e26-d6eb-4727-90d9-be42b7e5d180 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:41.542299 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-3e773e26-d6eb-4727-90d9-be42b7e5d180 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.126221 Aug 24 07:53:41.542941 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 541/1075] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:41 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:42.564980 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-27464007-e564-4a2f-8453-963309e60a47 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:42.565623 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-27464007-e564-4a2f-8453-963309e60a47 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:42.567994 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_api:SELECT=28 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:42.574025 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-27464007-e564-4a2f-8453-963309e60a47 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:42.574514 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-27464007-e564-4a2f-8453-963309e60a47 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:42.574979 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-27464007-e564-4a2f-8453-963309e60a47 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:42.575758 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-27464007-e564-4a2f-8453-963309e60a47 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:42.576237 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-27464007-e564-4a2f-8453-963309e60a47 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:42.576664 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-27464007-e564-4a2f-8453-963309e60a47 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:42.583089 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell1:SELECT=84 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:42.661640 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-27464007-e564-4a2f-8453-963309e60a47 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:42.670632 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-27464007-e564-4a2f-8453-963309e60a47 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.109530 Aug 24 07:53:42.670632 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 535/1076] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:42 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:43.695137 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-8df9d898-586f-4ba0-9883-7adb086372c2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:43.696263 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-8df9d898-586f-4ba0-9883-7adb086372c2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:43.698673 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_api:SELECT=28 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:43.704434 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8df9d898-586f-4ba0-9883-7adb086372c2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:43.704916 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8df9d898-586f-4ba0-9883-7adb086372c2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:43.705373 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8df9d898-586f-4ba0-9883-7adb086372c2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:43.706065 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8df9d898-586f-4ba0-9883-7adb086372c2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:43.706517 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8df9d898-586f-4ba0-9883-7adb086372c2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:43.706968 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8df9d898-586f-4ba0-9883-7adb086372c2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:43.710358 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell1:SELECT=84 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:43.780134 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-8df9d898-586f-4ba0-9883-7adb086372c2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:43.791412 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-8df9d898-586f-4ba0-9883-7adb086372c2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.103089 Aug 24 07:53:43.791994 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 542/1077] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:43 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:53:44.813536 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-56ddd8c9-305c-495c-a3f4-e2c36fd7e7b2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:44.814138 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-56ddd8c9-305c-495c-a3f4-e2c36fd7e7b2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:44.821274 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-56ddd8c9-305c-495c-a3f4-e2c36fd7e7b2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:44.821896 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-56ddd8c9-305c-495c-a3f4-e2c36fd7e7b2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:44.822434 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-56ddd8c9-305c-495c-a3f4-e2c36fd7e7b2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:44.823429 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-56ddd8c9-305c-495c-a3f4-e2c36fd7e7b2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:44.823986 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-56ddd8c9-305c-495c-a3f4-e2c36fd7e7b2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:44.824511 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-56ddd8c9-305c-495c-a3f4-e2c36fd7e7b2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:44.892688 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-56ddd8c9-305c-495c-a3f4-e2c36fd7e7b2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:44.901080 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-56ddd8c9-305c-495c-a3f4-e2c36fd7e7b2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.091703 Aug 24 07:53:44.901623 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 536/1078] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:44 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:45.922464 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-ecf7285f-86df-4f34-9c89-1eff8b4b40b7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:45.923220 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-ecf7285f-86df-4f34-9c89-1eff8b4b40b7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:45.930339 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ecf7285f-86df-4f34-9c89-1eff8b4b40b7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:45.930863 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ecf7285f-86df-4f34-9c89-1eff8b4b40b7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:45.931313 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ecf7285f-86df-4f34-9c89-1eff8b4b40b7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:45.932009 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ecf7285f-86df-4f34-9c89-1eff8b4b40b7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:45.932465 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ecf7285f-86df-4f34-9c89-1eff8b4b40b7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:45.932884 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ecf7285f-86df-4f34-9c89-1eff8b4b40b7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:46.007692 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-ecf7285f-86df-4f34-9c89-1eff8b4b40b7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:46.017910 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-ecf7285f-86df-4f34-9c89-1eff8b4b40b7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.099139 Aug 24 07:53:46.018722 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 543/1079] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:45 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:47.042129 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-4e902498-c232-40a0-ae5a-eadeab478ce7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:47.043037 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-4e902498-c232-40a0-ae5a-eadeab478ce7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:47.049860 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4e902498-c232-40a0-ae5a-eadeab478ce7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:47.050613 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4e902498-c232-40a0-ae5a-eadeab478ce7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:47.051073 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4e902498-c232-40a0-ae5a-eadeab478ce7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:47.051777 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4e902498-c232-40a0-ae5a-eadeab478ce7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:47.052328 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4e902498-c232-40a0-ae5a-eadeab478ce7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:47.052751 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4e902498-c232-40a0-ae5a-eadeab478ce7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:47.118786 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-4e902498-c232-40a0-ae5a-eadeab478ce7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:47.126969 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-4e902498-c232-40a0-ae5a-eadeab478ce7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.089769 Aug 24 07:53:47.127542 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 537/1080] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:47 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:48.150835 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-88f73684-0198-41c5-96ec-87ef431b1bdb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:48.151679 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-88f73684-0198-41c5-96ec-87ef431b1bdb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:48.158454 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-88f73684-0198-41c5-96ec-87ef431b1bdb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:48.158963 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-88f73684-0198-41c5-96ec-87ef431b1bdb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:48.159383 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-88f73684-0198-41c5-96ec-87ef431b1bdb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:48.160082 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-88f73684-0198-41c5-96ec-87ef431b1bdb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:48.160531 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-88f73684-0198-41c5-96ec-87ef431b1bdb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:48.161083 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-88f73684-0198-41c5-96ec-87ef431b1bdb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:48.224681 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-88f73684-0198-41c5-96ec-87ef431b1bdb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:48.233700 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-88f73684-0198-41c5-96ec-87ef431b1bdb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.087394 Aug 24 07:53:48.234297 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 544/1081] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:48 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:49.262882 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-24b50fa8-b344-4d67-8309-ccbaf0ff75de tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:49.263565 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-24b50fa8-b344-4d67-8309-ccbaf0ff75de tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:49.271876 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-24b50fa8-b344-4d67-8309-ccbaf0ff75de tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:49.272525 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-24b50fa8-b344-4d67-8309-ccbaf0ff75de tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:49.273048 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-24b50fa8-b344-4d67-8309-ccbaf0ff75de tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:49.273997 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-24b50fa8-b344-4d67-8309-ccbaf0ff75de tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:49.275769 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-24b50fa8-b344-4d67-8309-ccbaf0ff75de tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:49.276653 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-24b50fa8-b344-4d67-8309-ccbaf0ff75de tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:49.354947 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-24b50fa8-b344-4d67-8309-ccbaf0ff75de tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:49.369081 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-24b50fa8-b344-4d67-8309-ccbaf0ff75de tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.109958 Aug 24 07:53:49.370265 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 538/1082] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:49 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:53:50.394730 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-29d77839-cc1e-4925-913e-66bd43ce8506 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:50.395439 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-29d77839-cc1e-4925-913e-66bd43ce8506 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:50.403018 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-29d77839-cc1e-4925-913e-66bd43ce8506 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:50.403566 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-29d77839-cc1e-4925-913e-66bd43ce8506 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:50.404097 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-29d77839-cc1e-4925-913e-66bd43ce8506 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:50.404875 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-29d77839-cc1e-4925-913e-66bd43ce8506 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:50.405381 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-29d77839-cc1e-4925-913e-66bd43ce8506 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:50.405852 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-29d77839-cc1e-4925-913e-66bd43ce8506 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:50.487755 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-29d77839-cc1e-4925-913e-66bd43ce8506 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:50.496316 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-29d77839-cc1e-4925-913e-66bd43ce8506 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.105524 Aug 24 07:53:50.496895 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 545/1083] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:50 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:51.517614 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-7b2dc20c-cf38-426c-a047-a570259c7a31 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:51.518231 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-7b2dc20c-cf38-426c-a047-a570259c7a31 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:51.525727 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7b2dc20c-cf38-426c-a047-a570259c7a31 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:51.526213 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7b2dc20c-cf38-426c-a047-a570259c7a31 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:51.526642 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7b2dc20c-cf38-426c-a047-a570259c7a31 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:51.527367 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7b2dc20c-cf38-426c-a047-a570259c7a31 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:51.527817 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7b2dc20c-cf38-426c-a047-a570259c7a31 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:51.528231 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7b2dc20c-cf38-426c-a047-a570259c7a31 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:51.591759 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-7b2dc20c-cf38-426c-a047-a570259c7a31 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:51.600189 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-7b2dc20c-cf38-426c-a047-a570259c7a31 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.086506 Aug 24 07:53:51.600765 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 539/1084] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:51 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:52.622908 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-9ca95ccf-2b7a-43ea-a899-12023ffbad6a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:52.623580 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-9ca95ccf-2b7a-43ea-a899-12023ffbad6a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:52.630217 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9ca95ccf-2b7a-43ea-a899-12023ffbad6a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:52.630714 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9ca95ccf-2b7a-43ea-a899-12023ffbad6a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:52.631277 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9ca95ccf-2b7a-43ea-a899-12023ffbad6a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:52.632542 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9ca95ccf-2b7a-43ea-a899-12023ffbad6a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:52.632997 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9ca95ccf-2b7a-43ea-a899-12023ffbad6a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:52.633420 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9ca95ccf-2b7a-43ea-a899-12023ffbad6a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:52.693243 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-9ca95ccf-2b7a-43ea-a899-12023ffbad6a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:52.701717 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-9ca95ccf-2b7a-43ea-a899-12023ffbad6a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.083437 Aug 24 07:53:52.702279 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 546/1085] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:52 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:53.722013 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-ff0bcb45-5432-4327-827e-7a58f693274e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:53.722708 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-ff0bcb45-5432-4327-827e-7a58f693274e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:53.729812 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ff0bcb45-5432-4327-827e-7a58f693274e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:53.730298 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ff0bcb45-5432-4327-827e-7a58f693274e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:53.730761 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ff0bcb45-5432-4327-827e-7a58f693274e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:53.731472 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ff0bcb45-5432-4327-827e-7a58f693274e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:53.731922 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ff0bcb45-5432-4327-827e-7a58f693274e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:53.732458 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ff0bcb45-5432-4327-827e-7a58f693274e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:53.801966 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-ff0bcb45-5432-4327-827e-7a58f693274e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:53.812964 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-ff0bcb45-5432-4327-827e-7a58f693274e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.094742 Aug 24 07:53:53.813707 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 540/1086] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:53 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:54.837674 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-1469d707-5145-4b75-8d82-e92fc77608fd tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:54.838521 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-1469d707-5145-4b75-8d82-e92fc77608fd tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:54.845165 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1469d707-5145-4b75-8d82-e92fc77608fd tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:54.845574 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1469d707-5145-4b75-8d82-e92fc77608fd tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:54.846012 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1469d707-5145-4b75-8d82-e92fc77608fd tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:54.846836 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1469d707-5145-4b75-8d82-e92fc77608fd tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:54.847297 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1469d707-5145-4b75-8d82-e92fc77608fd tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:54.847717 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1469d707-5145-4b75-8d82-e92fc77608fd tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:54.913031 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-1469d707-5145-4b75-8d82-e92fc77608fd tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:54.921461 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-1469d707-5145-4b75-8d82-e92fc77608fd tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.089419 Aug 24 07:53:54.922036 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 547/1087] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:54 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:55.943016 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-48ee3d64-224b-4156-bd72-4290e095234a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:55.943858 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-48ee3d64-224b-4156-bd72-4290e095234a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:55.951219 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-48ee3d64-224b-4156-bd72-4290e095234a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:55.951707 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-48ee3d64-224b-4156-bd72-4290e095234a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:55.952136 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-48ee3d64-224b-4156-bd72-4290e095234a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:55.952869 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-48ee3d64-224b-4156-bd72-4290e095234a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:55.953286 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-48ee3d64-224b-4156-bd72-4290e095234a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:55.953703 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-48ee3d64-224b-4156-bd72-4290e095234a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:56.015056 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-48ee3d64-224b-4156-bd72-4290e095234a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:56.023380 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-48ee3d64-224b-4156-bd72-4290e095234a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.083642 Aug 24 07:53:56.023944 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 541/1088] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:55 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:57.044190 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-317dc3be-5f44-48b1-96b0-9cb3f988ec1f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:57.045077 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-317dc3be-5f44-48b1-96b0-9cb3f988ec1f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:57.051755 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-317dc3be-5f44-48b1-96b0-9cb3f988ec1f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:57.052252 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-317dc3be-5f44-48b1-96b0-9cb3f988ec1f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:57.052678 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-317dc3be-5f44-48b1-96b0-9cb3f988ec1f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:57.053383 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-317dc3be-5f44-48b1-96b0-9cb3f988ec1f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:57.054683 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-317dc3be-5f44-48b1-96b0-9cb3f988ec1f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:57.055131 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-317dc3be-5f44-48b1-96b0-9cb3f988ec1f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:57.121071 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-317dc3be-5f44-48b1-96b0-9cb3f988ec1f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:57.129324 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-317dc3be-5f44-48b1-96b0-9cb3f988ec1f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.088966 Aug 24 07:53:57.129923 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 548/1089] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:57 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:58.151974 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-f8e4afee-500f-4674-bb4e-d36649a10130 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:58.152616 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-f8e4afee-500f-4674-bb4e-d36649a10130 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:58.165602 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f8e4afee-500f-4674-bb4e-d36649a10130 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:58.166100 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f8e4afee-500f-4674-bb4e-d36649a10130 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:58.166542 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f8e4afee-500f-4674-bb4e-d36649a10130 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:58.167301 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f8e4afee-500f-4674-bb4e-d36649a10130 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:58.167789 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f8e4afee-500f-4674-bb4e-d36649a10130 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:58.168486 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f8e4afee-500f-4674-bb4e-d36649a10130 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:58.245287 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-f8e4afee-500f-4674-bb4e-d36649a10130 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:58.253911 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-f8e4afee-500f-4674-bb4e-d36649a10130 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.106401 Aug 24 07:53:58.254510 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 542/1090] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:58 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:53:59.278291 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-08068179-4cee-4196-a043-a2dabfdecbb9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:53:59.279225 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-08068179-4cee-4196-a043-a2dabfdecbb9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:53:59.287682 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-08068179-4cee-4196-a043-a2dabfdecbb9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:59.288881 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-08068179-4cee-4196-a043-a2dabfdecbb9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:59.289325 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-08068179-4cee-4196-a043-a2dabfdecbb9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:59.290615 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-08068179-4cee-4196-a043-a2dabfdecbb9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:53:59.291117 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-08068179-4cee-4196-a043-a2dabfdecbb9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:53:59.291629 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-08068179-4cee-4196-a043-a2dabfdecbb9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:53:59.362525 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-08068179-4cee-4196-a043-a2dabfdecbb9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:53:59.372101 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-08068179-4cee-4196-a043-a2dabfdecbb9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.099359 Aug 24 07:53:59.372709 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 549/1091] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:53:59 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:54:00.398119 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-e2118055-5a00-409c-a33f-3c3b22085a17 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:00.399191 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-e2118055-5a00-409c-a33f-3c3b22085a17 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:00.406254 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e2118055-5a00-409c-a33f-3c3b22085a17 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:00.406775 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e2118055-5a00-409c-a33f-3c3b22085a17 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:00.407216 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e2118055-5a00-409c-a33f-3c3b22085a17 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:00.407923 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e2118055-5a00-409c-a33f-3c3b22085a17 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:00.408379 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e2118055-5a00-409c-a33f-3c3b22085a17 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:00.408808 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e2118055-5a00-409c-a33f-3c3b22085a17 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:00.479117 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-e2118055-5a00-409c-a33f-3c3b22085a17 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:00.487504 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-e2118055-5a00-409c-a33f-3c3b22085a17 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.093710 Aug 24 07:54:00.488091 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 543/1092] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:00 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:54:01.511998 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-edeefc98-b554-4c41-a72d-f5948662005c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:01.513037 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-edeefc98-b554-4c41-a72d-f5948662005c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:01.522607 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-edeefc98-b554-4c41-a72d-f5948662005c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:01.523410 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-edeefc98-b554-4c41-a72d-f5948662005c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:01.524026 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-edeefc98-b554-4c41-a72d-f5948662005c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:01.525141 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-edeefc98-b554-4c41-a72d-f5948662005c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:01.525931 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-edeefc98-b554-4c41-a72d-f5948662005c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:01.526578 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-edeefc98-b554-4c41-a72d-f5948662005c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:01.594530 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-edeefc98-b554-4c41-a72d-f5948662005c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:01.606319 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-edeefc98-b554-4c41-a72d-f5948662005c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.100470 Aug 24 07:54:01.607434 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 550/1093] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:01 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:54:02.628399 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-e3a24cf1-cb09-46d2-8f22-56fa7b4cfdcc tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:02.629026 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-e3a24cf1-cb09-46d2-8f22-56fa7b4cfdcc tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:02.642199 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e3a24cf1-cb09-46d2-8f22-56fa7b4cfdcc tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:02.642801 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e3a24cf1-cb09-46d2-8f22-56fa7b4cfdcc tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:02.643474 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e3a24cf1-cb09-46d2-8f22-56fa7b4cfdcc tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:02.644265 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e3a24cf1-cb09-46d2-8f22-56fa7b4cfdcc tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:02.644747 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e3a24cf1-cb09-46d2-8f22-56fa7b4cfdcc tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:02.645169 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e3a24cf1-cb09-46d2-8f22-56fa7b4cfdcc tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:02.721214 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-e3a24cf1-cb09-46d2-8f22-56fa7b4cfdcc tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:02.729568 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-e3a24cf1-cb09-46d2-8f22-56fa7b4cfdcc tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.104993 Aug 24 07:54:02.730149 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 544/1094] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:02 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:03.750781 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-a8c82873-b3e4-42d3-8536-07de3b8c5b1d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:03.751325 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-a8c82873-b3e4-42d3-8536-07de3b8c5b1d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:03.765380 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a8c82873-b3e4-42d3-8536-07de3b8c5b1d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:03.766237 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a8c82873-b3e4-42d3-8536-07de3b8c5b1d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:03.767082 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a8c82873-b3e4-42d3-8536-07de3b8c5b1d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:03.768359 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a8c82873-b3e4-42d3-8536-07de3b8c5b1d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:03.769168 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a8c82873-b3e4-42d3-8536-07de3b8c5b1d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:03.769946 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a8c82873-b3e4-42d3-8536-07de3b8c5b1d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:03.853108 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-a8c82873-b3e4-42d3-8536-07de3b8c5b1d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:03.860888 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-a8c82873-b3e4-42d3-8536-07de3b8c5b1d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.114063 Aug 24 07:54:03.861461 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 551/1095] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:03 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:04.886628 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-48f1e6a3-efaa-4ca2-a56e-07d8098356a8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:04.887243 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-48f1e6a3-efaa-4ca2-a56e-07d8098356a8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:04.894265 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-48f1e6a3-efaa-4ca2-a56e-07d8098356a8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:04.894825 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-48f1e6a3-efaa-4ca2-a56e-07d8098356a8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:04.895344 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-48f1e6a3-efaa-4ca2-a56e-07d8098356a8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:04.896154 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-48f1e6a3-efaa-4ca2-a56e-07d8098356a8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:04.896647 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-48f1e6a3-efaa-4ca2-a56e-07d8098356a8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:04.897111 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-48f1e6a3-efaa-4ca2-a56e-07d8098356a8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:04.980203 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-48f1e6a3-efaa-4ca2-a56e-07d8098356a8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:04.989574 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-48f1e6a3-efaa-4ca2-a56e-07d8098356a8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.106819 Aug 24 07:54:04.990140 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 545/1096] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:04 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:06.011080 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-3647cf75-d518-479f-ba4b-7d8b7aa73882 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:06.011717 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-3647cf75-d518-479f-ba4b-7d8b7aa73882 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:06.018236 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3647cf75-d518-479f-ba4b-7d8b7aa73882 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:06.018740 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3647cf75-d518-479f-ba4b-7d8b7aa73882 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:06.019182 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3647cf75-d518-479f-ba4b-7d8b7aa73882 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:06.019886 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3647cf75-d518-479f-ba4b-7d8b7aa73882 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:06.020343 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3647cf75-d518-479f-ba4b-7d8b7aa73882 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:06.020768 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3647cf75-d518-479f-ba4b-7d8b7aa73882 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:06.101773 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-3647cf75-d518-479f-ba4b-7d8b7aa73882 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:06.109795 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-3647cf75-d518-479f-ba4b-7d8b7aa73882 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.103201 Aug 24 07:54:06.110432 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 552/1097] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:06 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:07.131229 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-973ea263-c6b9-4a14-9dcd-63f6bc5d2d5b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:07.132385 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-973ea263-c6b9-4a14-9dcd-63f6bc5d2d5b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:07.138853 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-973ea263-c6b9-4a14-9dcd-63f6bc5d2d5b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:07.139336 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-973ea263-c6b9-4a14-9dcd-63f6bc5d2d5b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:07.139766 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-973ea263-c6b9-4a14-9dcd-63f6bc5d2d5b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:07.140456 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-973ea263-c6b9-4a14-9dcd-63f6bc5d2d5b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:07.140906 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-973ea263-c6b9-4a14-9dcd-63f6bc5d2d5b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:07.141324 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-973ea263-c6b9-4a14-9dcd-63f6bc5d2d5b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:07.209800 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-973ea263-c6b9-4a14-9dcd-63f6bc5d2d5b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:07.218289 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-973ea263-c6b9-4a14-9dcd-63f6bc5d2d5b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.090931 Aug 24 07:54:07.218886 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 546/1098] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:07 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:08.239254 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-2ba3ff1e-2d5a-4a80-b5f8-4b4a17258215 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:08.239864 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-2ba3ff1e-2d5a-4a80-b5f8-4b4a17258215 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:08.246644 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2ba3ff1e-2d5a-4a80-b5f8-4b4a17258215 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:08.247278 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2ba3ff1e-2d5a-4a80-b5f8-4b4a17258215 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:08.247921 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2ba3ff1e-2d5a-4a80-b5f8-4b4a17258215 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:08.248722 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2ba3ff1e-2d5a-4a80-b5f8-4b4a17258215 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:08.249178 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2ba3ff1e-2d5a-4a80-b5f8-4b4a17258215 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:08.249591 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2ba3ff1e-2d5a-4a80-b5f8-4b4a17258215 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:08.313751 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-2ba3ff1e-2d5a-4a80-b5f8-4b4a17258215 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:08.321379 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-2ba3ff1e-2d5a-4a80-b5f8-4b4a17258215 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.085947 Aug 24 07:54:08.321939 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 553/1099] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:08 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:09.346554 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-50777ba6-3875-481d-93d5-088976b4f9b0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:09.347208 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-50777ba6-3875-481d-93d5-088976b4f9b0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:09.354447 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-50777ba6-3875-481d-93d5-088976b4f9b0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:09.354956 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-50777ba6-3875-481d-93d5-088976b4f9b0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:09.355393 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-50777ba6-3875-481d-93d5-088976b4f9b0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:09.356096 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-50777ba6-3875-481d-93d5-088976b4f9b0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:09.356552 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-50777ba6-3875-481d-93d5-088976b4f9b0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:09.356978 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-50777ba6-3875-481d-93d5-088976b4f9b0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:09.438212 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-50777ba6-3875-481d-93d5-088976b4f9b0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:09.446056 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-50777ba6-3875-481d-93d5-088976b4f9b0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.103437 Aug 24 07:54:09.446608 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 547/1100] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:09 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:10.469735 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-45f09df5-2ab8-4cab-8908-01b3a12fb562 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:10.470424 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-45f09df5-2ab8-4cab-8908-01b3a12fb562 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:10.478584 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-45f09df5-2ab8-4cab-8908-01b3a12fb562 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:10.479339 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-45f09df5-2ab8-4cab-8908-01b3a12fb562 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:10.479935 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-45f09df5-2ab8-4cab-8908-01b3a12fb562 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:10.480950 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-45f09df5-2ab8-4cab-8908-01b3a12fb562 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:10.481638 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-45f09df5-2ab8-4cab-8908-01b3a12fb562 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:10.482135 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-45f09df5-2ab8-4cab-8908-01b3a12fb562 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:10.545938 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-45f09df5-2ab8-4cab-8908-01b3a12fb562 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:10.556369 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-45f09df5-2ab8-4cab-8908-01b3a12fb562 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.092038 Aug 24 07:54:10.556950 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 554/1101] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:10 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:11.581726 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-6a772d2a-b12a-4532-97d0-8f7c32a111a6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:11.582935 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-6a772d2a-b12a-4532-97d0-8f7c32a111a6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:11.596130 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6a772d2a-b12a-4532-97d0-8f7c32a111a6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:11.597022 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6a772d2a-b12a-4532-97d0-8f7c32a111a6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:11.597747 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6a772d2a-b12a-4532-97d0-8f7c32a111a6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:11.598879 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6a772d2a-b12a-4532-97d0-8f7c32a111a6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:11.599357 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6a772d2a-b12a-4532-97d0-8f7c32a111a6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:11.599932 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6a772d2a-b12a-4532-97d0-8f7c32a111a6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:11.679399 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-6a772d2a-b12a-4532-97d0-8f7c32a111a6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:11.689364 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-6a772d2a-b12a-4532-97d0-8f7c32a111a6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.114736 Aug 24 07:54:11.690006 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 548/1102] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:11 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:12.710910 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-cca03041-89cd-4661-8f61-a08818d93be1 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:12.712041 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-cca03041-89cd-4661-8f61-a08818d93be1 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:12.722244 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cca03041-89cd-4661-8f61-a08818d93be1 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:12.723094 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cca03041-89cd-4661-8f61-a08818d93be1 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:12.723847 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cca03041-89cd-4661-8f61-a08818d93be1 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:12.725107 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cca03041-89cd-4661-8f61-a08818d93be1 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:12.725942 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cca03041-89cd-4661-8f61-a08818d93be1 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:12.726475 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cca03041-89cd-4661-8f61-a08818d93be1 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:12.816070 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-cca03041-89cd-4661-8f61-a08818d93be1 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:12.824772 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-cca03041-89cd-4661-8f61-a08818d93be1 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.117978 Aug 24 07:54:12.825369 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 555/1103] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:12 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:13.845863 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-eb07528d-d185-4af6-a04c-6f1dcb875850 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:13.846465 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-eb07528d-d185-4af6-a04c-6f1dcb875850 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:13.848829 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_api:SELECT=28 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:13.855092 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-eb07528d-d185-4af6-a04c-6f1dcb875850 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:13.855579 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-eb07528d-d185-4af6-a04c-6f1dcb875850 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:13.856018 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-eb07528d-d185-4af6-a04c-6f1dcb875850 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:13.856721 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-eb07528d-d185-4af6-a04c-6f1dcb875850 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:13.857182 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-eb07528d-d185-4af6-a04c-6f1dcb875850 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:13.857610 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-eb07528d-d185-4af6-a04c-6f1dcb875850 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:13.860751 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell1:SELECT=84 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:13.927179 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-eb07528d-d185-4af6-a04c-6f1dcb875850 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:13.936781 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-eb07528d-d185-4af6-a04c-6f1dcb875850 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.094880 Aug 24 07:54:13.937423 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 549/1104] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:13 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:54:14.958434 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-3f092876-7e01-4c85-940e-aca06bd476b2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:14.959323 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-3f092876-7e01-4c85-940e-aca06bd476b2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:14.962189 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_api:SELECT=28 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:14.968935 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3f092876-7e01-4c85-940e-aca06bd476b2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:14.969419 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3f092876-7e01-4c85-940e-aca06bd476b2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:14.970097 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3f092876-7e01-4c85-940e-aca06bd476b2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:14.970806 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3f092876-7e01-4c85-940e-aca06bd476b2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:14.971388 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3f092876-7e01-4c85-940e-aca06bd476b2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:14.971682 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3f092876-7e01-4c85-940e-aca06bd476b2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:14.975507 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell1:SELECT=84 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:15.052050 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-3f092876-7e01-4c85-940e-aca06bd476b2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:15.064125 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-3f092876-7e01-4c85-940e-aca06bd476b2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.109692 Aug 24 07:54:15.065300 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 556/1105] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:14 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:16.090156 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-01c0dc74-259f-437d-9ff8-a887a0a5ed36 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:16.091114 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-01c0dc74-259f-437d-9ff8-a887a0a5ed36 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:16.102358 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-01c0dc74-259f-437d-9ff8-a887a0a5ed36 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:16.103241 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-01c0dc74-259f-437d-9ff8-a887a0a5ed36 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:16.103920 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-01c0dc74-259f-437d-9ff8-a887a0a5ed36 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:16.105217 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-01c0dc74-259f-437d-9ff8-a887a0a5ed36 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:16.105924 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-01c0dc74-259f-437d-9ff8-a887a0a5ed36 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:16.106742 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-01c0dc74-259f-437d-9ff8-a887a0a5ed36 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:16.202331 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-01c0dc74-259f-437d-9ff8-a887a0a5ed36 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:16.218279 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-01c0dc74-259f-437d-9ff8-a887a0a5ed36 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.134920 Aug 24 07:54:16.219157 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 550/1106] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:16 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:17.246229 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-fbcc9357-60ec-48b2-92d8-b03f8212b7eb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:17.246904 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-fbcc9357-60ec-48b2-92d8-b03f8212b7eb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:17.253557 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fbcc9357-60ec-48b2-92d8-b03f8212b7eb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:17.254116 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fbcc9357-60ec-48b2-92d8-b03f8212b7eb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:17.254588 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fbcc9357-60ec-48b2-92d8-b03f8212b7eb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:17.255332 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fbcc9357-60ec-48b2-92d8-b03f8212b7eb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:17.255862 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fbcc9357-60ec-48b2-92d8-b03f8212b7eb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:17.256337 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fbcc9357-60ec-48b2-92d8-b03f8212b7eb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:17.335838 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-fbcc9357-60ec-48b2-92d8-b03f8212b7eb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:17.347101 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-fbcc9357-60ec-48b2-92d8-b03f8212b7eb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.110909 Aug 24 07:54:17.348016 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 557/1107] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:17 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:18.372340 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-7254d7fd-2ecf-4a31-b106-4b7276f47ecb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:18.373429 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-7254d7fd-2ecf-4a31-b106-4b7276f47ecb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:18.384313 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7254d7fd-2ecf-4a31-b106-4b7276f47ecb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:18.385000 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7254d7fd-2ecf-4a31-b106-4b7276f47ecb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:18.385611 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7254d7fd-2ecf-4a31-b106-4b7276f47ecb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:18.386493 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7254d7fd-2ecf-4a31-b106-4b7276f47ecb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:18.387034 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7254d7fd-2ecf-4a31-b106-4b7276f47ecb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:18.387645 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7254d7fd-2ecf-4a31-b106-4b7276f47ecb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:18.460773 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-7254d7fd-2ecf-4a31-b106-4b7276f47ecb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:18.469468 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-7254d7fd-2ecf-4a31-b106-4b7276f47ecb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.103149 Aug 24 07:54:18.470077 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 551/1108] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:18 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:19.494244 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-6493f0e7-6fd2-4ef0-8585-1006f7a61a24 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:19.494892 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-6493f0e7-6fd2-4ef0-8585-1006f7a61a24 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:19.501564 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6493f0e7-6fd2-4ef0-8585-1006f7a61a24 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:19.502049 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6493f0e7-6fd2-4ef0-8585-1006f7a61a24 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:19.502485 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6493f0e7-6fd2-4ef0-8585-1006f7a61a24 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:19.503219 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6493f0e7-6fd2-4ef0-8585-1006f7a61a24 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:19.503679 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6493f0e7-6fd2-4ef0-8585-1006f7a61a24 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:19.504101 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6493f0e7-6fd2-4ef0-8585-1006f7a61a24 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:19.568308 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-6493f0e7-6fd2-4ef0-8585-1006f7a61a24 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:19.576633 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-6493f0e7-6fd2-4ef0-8585-1006f7a61a24 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.086888 Aug 24 07:54:19.577204 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 558/1109] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:19 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:54:20.602426 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-07e7a64b-57a1-4538-b737-bfd0487a09ed tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:20.603480 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-07e7a64b-57a1-4538-b737-bfd0487a09ed tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:20.614023 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-07e7a64b-57a1-4538-b737-bfd0487a09ed tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:20.614925 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-07e7a64b-57a1-4538-b737-bfd0487a09ed tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:20.615664 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-07e7a64b-57a1-4538-b737-bfd0487a09ed tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:20.616883 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-07e7a64b-57a1-4538-b737-bfd0487a09ed tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:20.617662 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-07e7a64b-57a1-4538-b737-bfd0487a09ed tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:20.618373 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-07e7a64b-57a1-4538-b737-bfd0487a09ed tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:20.718594 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-07e7a64b-57a1-4538-b737-bfd0487a09ed tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:20.731183 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-07e7a64b-57a1-4538-b737-bfd0487a09ed tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.135742 Aug 24 07:54:20.732144 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 552/1110] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:20 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:21.768241 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-86c89a36-7154-4f83-a68d-ed854aa3a91d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:21.769159 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-86c89a36-7154-4f83-a68d-ed854aa3a91d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:21.776053 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-86c89a36-7154-4f83-a68d-ed854aa3a91d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:21.776538 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-86c89a36-7154-4f83-a68d-ed854aa3a91d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:21.776977 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-86c89a36-7154-4f83-a68d-ed854aa3a91d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:21.777678 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-86c89a36-7154-4f83-a68d-ed854aa3a91d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:21.778144 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-86c89a36-7154-4f83-a68d-ed854aa3a91d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:21.778559 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-86c89a36-7154-4f83-a68d-ed854aa3a91d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:21.846306 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-86c89a36-7154-4f83-a68d-ed854aa3a91d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:21.854906 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-86c89a36-7154-4f83-a68d-ed854aa3a91d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.090706 Aug 24 07:54:21.855490 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 559/1111] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:21 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:22.882808 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-1d7b93f8-f9c7-4c90-a43b-d5a78b70c3dc tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:22.883458 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-1d7b93f8-f9c7-4c90-a43b-d5a78b70c3dc tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:22.890446 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1d7b93f8-f9c7-4c90-a43b-d5a78b70c3dc tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:22.891042 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1d7b93f8-f9c7-4c90-a43b-d5a78b70c3dc tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:22.891540 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1d7b93f8-f9c7-4c90-a43b-d5a78b70c3dc tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:22.892288 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1d7b93f8-f9c7-4c90-a43b-d5a78b70c3dc tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:22.892785 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1d7b93f8-f9c7-4c90-a43b-d5a78b70c3dc tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:22.893251 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1d7b93f8-f9c7-4c90-a43b-d5a78b70c3dc tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:22.972421 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-1d7b93f8-f9c7-4c90-a43b-d5a78b70c3dc tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:22.983152 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-1d7b93f8-f9c7-4c90-a43b-d5a78b70c3dc tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.104946 Aug 24 07:54:22.983949 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 553/1112] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:22 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:24.012813 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-202cef06-45c0-42ee-a322-3a743c670a5c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:24.017558 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-202cef06-45c0-42ee-a322-3a743c670a5c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:24.025997 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-202cef06-45c0-42ee-a322-3a743c670a5c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:24.026922 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-202cef06-45c0-42ee-a322-3a743c670a5c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:24.027708 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-202cef06-45c0-42ee-a322-3a743c670a5c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:24.028678 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-202cef06-45c0-42ee-a322-3a743c670a5c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:24.029318 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-202cef06-45c0-42ee-a322-3a743c670a5c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:24.030005 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-202cef06-45c0-42ee-a322-3a743c670a5c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:24.108304 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-202cef06-45c0-42ee-a322-3a743c670a5c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:24.122583 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-202cef06-45c0-42ee-a322-3a743c670a5c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.115929 Aug 24 07:54:24.123700 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 560/1113] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:24 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:25.153790 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-f035c610-7f4d-4472-9a3a-27e7054878db tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:25.154548 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-f035c610-7f4d-4472-9a3a-27e7054878db tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:25.161273 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f035c610-7f4d-4472-9a3a-27e7054878db tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:25.161760 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f035c610-7f4d-4472-9a3a-27e7054878db tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:25.162191 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f035c610-7f4d-4472-9a3a-27e7054878db tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:25.163000 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f035c610-7f4d-4472-9a3a-27e7054878db tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:25.163534 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f035c610-7f4d-4472-9a3a-27e7054878db tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:25.163955 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f035c610-7f4d-4472-9a3a-27e7054878db tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:25.248694 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-f035c610-7f4d-4472-9a3a-27e7054878db tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:25.262524 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-f035c610-7f4d-4472-9a3a-27e7054878db tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.112647 Aug 24 07:54:25.263167 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 554/1114] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:25 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:54:26.290901 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-96fc04e6-60fe-456d-a958-c571af9b71d5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:26.292021 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-96fc04e6-60fe-456d-a958-c571af9b71d5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:26.301274 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-96fc04e6-60fe-456d-a958-c571af9b71d5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:26.302103 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-96fc04e6-60fe-456d-a958-c571af9b71d5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:26.302717 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-96fc04e6-60fe-456d-a958-c571af9b71d5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:26.303479 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-96fc04e6-60fe-456d-a958-c571af9b71d5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:26.303994 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-96fc04e6-60fe-456d-a958-c571af9b71d5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:26.304569 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-96fc04e6-60fe-456d-a958-c571af9b71d5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:26.375719 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-96fc04e6-60fe-456d-a958-c571af9b71d5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:26.389574 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-96fc04e6-60fe-456d-a958-c571af9b71d5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.106332 Aug 24 07:54:26.390644 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 561/1115] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:26 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:54:27.422381 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-bf2fc8ed-b4cc-4727-8a0a-1dcb1c3bdf9d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:27.423126 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-bf2fc8ed-b4cc-4727-8a0a-1dcb1c3bdf9d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:27.430403 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bf2fc8ed-b4cc-4727-8a0a-1dcb1c3bdf9d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:27.430944 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bf2fc8ed-b4cc-4727-8a0a-1dcb1c3bdf9d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:27.431386 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bf2fc8ed-b4cc-4727-8a0a-1dcb1c3bdf9d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:27.432107 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bf2fc8ed-b4cc-4727-8a0a-1dcb1c3bdf9d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:27.432569 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bf2fc8ed-b4cc-4727-8a0a-1dcb1c3bdf9d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:27.432995 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-bf2fc8ed-b4cc-4727-8a0a-1dcb1c3bdf9d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:27.498222 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-bf2fc8ed-b4cc-4727-8a0a-1dcb1c3bdf9d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:27.506623 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-bf2fc8ed-b4cc-4727-8a0a-1dcb1c3bdf9d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.088271 Aug 24 07:54:27.507754 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 555/1116] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:27 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:54:28.529025 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-9e75f2ba-640c-45b7-9e91-34d179ca4931 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:28.529700 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-9e75f2ba-640c-45b7-9e91-34d179ca4931 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:28.535894 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9e75f2ba-640c-45b7-9e91-34d179ca4931 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:28.536437 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9e75f2ba-640c-45b7-9e91-34d179ca4931 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:28.536919 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9e75f2ba-640c-45b7-9e91-34d179ca4931 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:28.537681 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9e75f2ba-640c-45b7-9e91-34d179ca4931 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:28.538193 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9e75f2ba-640c-45b7-9e91-34d179ca4931 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:28.538661 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9e75f2ba-640c-45b7-9e91-34d179ca4931 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:28.613325 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-9e75f2ba-640c-45b7-9e91-34d179ca4931 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:28.622411 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-9e75f2ba-640c-45b7-9e91-34d179ca4931 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.097354 Aug 24 07:54:28.623127 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 562/1117] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:28 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:29.650320 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-4ded9197-bb3e-4e01-a608-240d12385ac2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:29.651428 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-4ded9197-bb3e-4e01-a608-240d12385ac2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:29.660040 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4ded9197-bb3e-4e01-a608-240d12385ac2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:29.660839 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4ded9197-bb3e-4e01-a608-240d12385ac2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:29.661893 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4ded9197-bb3e-4e01-a608-240d12385ac2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:29.664079 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4ded9197-bb3e-4e01-a608-240d12385ac2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:29.664598 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4ded9197-bb3e-4e01-a608-240d12385ac2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:29.665399 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4ded9197-bb3e-4e01-a608-240d12385ac2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:29.738333 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-4ded9197-bb3e-4e01-a608-240d12385ac2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:29.747048 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-4ded9197-bb3e-4e01-a608-240d12385ac2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.105410 Aug 24 07:54:29.747628 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 556/1118] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:29 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:30.768435 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-8912f51b-9802-4819-8bda-33cb414dee22 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:30.769358 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-8912f51b-9802-4819-8bda-33cb414dee22 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:30.777988 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8912f51b-9802-4819-8bda-33cb414dee22 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:30.778753 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8912f51b-9802-4819-8bda-33cb414dee22 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:30.779469 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8912f51b-9802-4819-8bda-33cb414dee22 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:30.780627 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8912f51b-9802-4819-8bda-33cb414dee22 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:30.781450 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8912f51b-9802-4819-8bda-33cb414dee22 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:30.782122 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8912f51b-9802-4819-8bda-33cb414dee22 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:30.879372 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-8912f51b-9802-4819-8bda-33cb414dee22 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:30.893459 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-8912f51b-9802-4819-8bda-33cb414dee22 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.128683 Aug 24 07:54:30.894545 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 563/1119] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:30 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:31.916469 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-5c08c2aa-3797-4f57-8581-60dad35b49a8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:31.917402 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-5c08c2aa-3797-4f57-8581-60dad35b49a8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:31.924269 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5c08c2aa-3797-4f57-8581-60dad35b49a8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:31.924801 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5c08c2aa-3797-4f57-8581-60dad35b49a8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:31.925287 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5c08c2aa-3797-4f57-8581-60dad35b49a8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:31.926027 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5c08c2aa-3797-4f57-8581-60dad35b49a8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:31.926823 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5c08c2aa-3797-4f57-8581-60dad35b49a8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:31.927347 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5c08c2aa-3797-4f57-8581-60dad35b49a8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:31.995413 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-5c08c2aa-3797-4f57-8581-60dad35b49a8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:32.007850 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-5c08c2aa-3797-4f57-8581-60dad35b49a8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.095171 Aug 24 07:54:32.008500 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 557/1120] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:31 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:33.030821 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-fcf45c80-6342-45eb-874d-5587a50a0a30 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:33.031782 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-fcf45c80-6342-45eb-874d-5587a50a0a30 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:33.040315 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fcf45c80-6342-45eb-874d-5587a50a0a30 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:33.040789 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fcf45c80-6342-45eb-874d-5587a50a0a30 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:33.041224 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fcf45c80-6342-45eb-874d-5587a50a0a30 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:33.041949 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fcf45c80-6342-45eb-874d-5587a50a0a30 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:33.042401 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fcf45c80-6342-45eb-874d-5587a50a0a30 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:33.042861 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fcf45c80-6342-45eb-874d-5587a50a0a30 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:33.125597 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-fcf45c80-6342-45eb-874d-5587a50a0a30 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:33.135064 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-fcf45c80-6342-45eb-874d-5587a50a0a30 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.109009 Aug 24 07:54:33.135734 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 564/1121] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:33 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:34.164792 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-a7cf49ad-9ef6-46db-b0dd-cb0b39ad92a3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:34.165705 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-a7cf49ad-9ef6-46db-b0dd-cb0b39ad92a3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:34.172945 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a7cf49ad-9ef6-46db-b0dd-cb0b39ad92a3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:34.173473 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a7cf49ad-9ef6-46db-b0dd-cb0b39ad92a3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:34.174012 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a7cf49ad-9ef6-46db-b0dd-cb0b39ad92a3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:34.174849 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a7cf49ad-9ef6-46db-b0dd-cb0b39ad92a3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:34.175531 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a7cf49ad-9ef6-46db-b0dd-cb0b39ad92a3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:34.176500 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a7cf49ad-9ef6-46db-b0dd-cb0b39ad92a3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:34.268976 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-a7cf49ad-9ef6-46db-b0dd-cb0b39ad92a3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:34.281798 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-a7cf49ad-9ef6-46db-b0dd-cb0b39ad92a3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.123137 Aug 24 07:54:34.282709 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 558/1122] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:34 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:35.317865 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-4f09acbf-7d53-47a5-950b-1e53e693e585 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:35.319040 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-4f09acbf-7d53-47a5-950b-1e53e693e585 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:35.330346 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4f09acbf-7d53-47a5-950b-1e53e693e585 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:35.331158 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4f09acbf-7d53-47a5-950b-1e53e693e585 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:35.331860 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4f09acbf-7d53-47a5-950b-1e53e693e585 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:35.332975 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4f09acbf-7d53-47a5-950b-1e53e693e585 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:35.333702 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4f09acbf-7d53-47a5-950b-1e53e693e585 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:35.334374 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4f09acbf-7d53-47a5-950b-1e53e693e585 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:35.414079 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-4f09acbf-7d53-47a5-950b-1e53e693e585 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:35.429082 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-4f09acbf-7d53-47a5-950b-1e53e693e585 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.118185 Aug 24 07:54:35.430114 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 565/1123] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:35 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:36.463834 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-9c3f368e-7d7a-471f-998b-27b3e4c73d7d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:36.464521 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-9c3f368e-7d7a-471f-998b-27b3e4c73d7d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:36.471932 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9c3f368e-7d7a-471f-998b-27b3e4c73d7d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:36.472602 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9c3f368e-7d7a-471f-998b-27b3e4c73d7d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:36.473095 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9c3f368e-7d7a-471f-998b-27b3e4c73d7d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:36.473860 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9c3f368e-7d7a-471f-998b-27b3e4c73d7d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:36.474319 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9c3f368e-7d7a-471f-998b-27b3e4c73d7d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:36.474791 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-9c3f368e-7d7a-471f-998b-27b3e4c73d7d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:36.565374 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-9c3f368e-7d7a-471f-998b-27b3e4c73d7d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:36.573775 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-9c3f368e-7d7a-471f-998b-27b3e4c73d7d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.113802 Aug 24 07:54:36.574458 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 559/1124] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:36 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:54:37.596786 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-5af42fc8-ec7f-429f-a37d-e5de70da3723 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:37.597987 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-5af42fc8-ec7f-429f-a37d-e5de70da3723 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:37.607808 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5af42fc8-ec7f-429f-a37d-e5de70da3723 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:37.608649 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5af42fc8-ec7f-429f-a37d-e5de70da3723 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:37.609404 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5af42fc8-ec7f-429f-a37d-e5de70da3723 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:37.610767 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5af42fc8-ec7f-429f-a37d-e5de70da3723 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:37.611544 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5af42fc8-ec7f-429f-a37d-e5de70da3723 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:37.612281 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5af42fc8-ec7f-429f-a37d-e5de70da3723 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:37.696562 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-5af42fc8-ec7f-429f-a37d-e5de70da3723 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:37.709924 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-5af42fc8-ec7f-429f-a37d-e5de70da3723 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.118504 Aug 24 07:54:37.710962 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 566/1125] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:37 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:54:38.746232 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-09ef67db-e875-498f-b5b0-8562525c36b6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:38.747518 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-09ef67db-e875-498f-b5b0-8562525c36b6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:38.756134 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-09ef67db-e875-498f-b5b0-8562525c36b6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:38.756619 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-09ef67db-e875-498f-b5b0-8562525c36b6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:38.757715 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-09ef67db-e875-498f-b5b0-8562525c36b6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:38.758416 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-09ef67db-e875-498f-b5b0-8562525c36b6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:38.758905 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-09ef67db-e875-498f-b5b0-8562525c36b6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:38.759327 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-09ef67db-e875-498f-b5b0-8562525c36b6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:38.834807 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-09ef67db-e875-498f-b5b0-8562525c36b6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:38.843458 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-09ef67db-e875-498f-b5b0-8562525c36b6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.104477 Aug 24 07:54:38.844057 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 560/1126] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:38 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:39.866883 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-fe60001e-e6de-4960-a1c4-c23b29672e48 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:39.867739 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-fe60001e-e6de-4960-a1c4-c23b29672e48 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:39.876333 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fe60001e-e6de-4960-a1c4-c23b29672e48 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:39.876812 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fe60001e-e6de-4960-a1c4-c23b29672e48 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:39.877352 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fe60001e-e6de-4960-a1c4-c23b29672e48 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:39.878371 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fe60001e-e6de-4960-a1c4-c23b29672e48 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:39.878857 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fe60001e-e6de-4960-a1c4-c23b29672e48 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:39.879311 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fe60001e-e6de-4960-a1c4-c23b29672e48 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:39.956409 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-fe60001e-e6de-4960-a1c4-c23b29672e48 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:39.965848 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-fe60001e-e6de-4960-a1c4-c23b29672e48 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.105141 Aug 24 07:54:39.966611 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 567/1127] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:39 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:40.999430 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-0375c2f0-9363-4315-bdaf-01b87da836d2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:41.000207 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-0375c2f0-9363-4315-bdaf-01b87da836d2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:41.007359 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0375c2f0-9363-4315-bdaf-01b87da836d2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:41.007892 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0375c2f0-9363-4315-bdaf-01b87da836d2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:41.008372 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0375c2f0-9363-4315-bdaf-01b87da836d2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:41.009108 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0375c2f0-9363-4315-bdaf-01b87da836d2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:41.009601 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0375c2f0-9363-4315-bdaf-01b87da836d2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:41.010121 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0375c2f0-9363-4315-bdaf-01b87da836d2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:41.080802 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-0375c2f0-9363-4315-bdaf-01b87da836d2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:41.089626 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-0375c2f0-9363-4315-bdaf-01b87da836d2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.094041 Aug 24 07:54:41.090264 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 561/1128] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:40 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:42.126095 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-2733b4b4-524d-459c-85a8-8961113a5393 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:42.127127 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-2733b4b4-524d-459c-85a8-8961113a5393 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:42.137638 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2733b4b4-524d-459c-85a8-8961113a5393 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:42.138177 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2733b4b4-524d-459c-85a8-8961113a5393 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:42.138658 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2733b4b4-524d-459c-85a8-8961113a5393 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:42.139602 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2733b4b4-524d-459c-85a8-8961113a5393 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:42.140059 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2733b4b4-524d-459c-85a8-8961113a5393 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:42.140489 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2733b4b4-524d-459c-85a8-8961113a5393 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:42.212793 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-2733b4b4-524d-459c-85a8-8961113a5393 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:42.222102 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-2733b4b4-524d-459c-85a8-8961113a5393 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.101843 Aug 24 07:54:42.223527 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 568/1129] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:42 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:43.244763 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-37783502-1421-4e70-87f9-944ab40e89bb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:43.245640 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-37783502-1421-4e70-87f9-944ab40e89bb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:43.255236 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-37783502-1421-4e70-87f9-944ab40e89bb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:43.256032 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-37783502-1421-4e70-87f9-944ab40e89bb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:43.256762 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-37783502-1421-4e70-87f9-944ab40e89bb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:43.258527 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-37783502-1421-4e70-87f9-944ab40e89bb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:43.259089 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-37783502-1421-4e70-87f9-944ab40e89bb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:43.259760 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-37783502-1421-4e70-87f9-944ab40e89bb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:43.349367 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-37783502-1421-4e70-87f9-944ab40e89bb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:43.364375 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-37783502-1421-4e70-87f9-944ab40e89bb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.123437 Aug 24 07:54:43.365207 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 562/1130] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:43 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:44.387806 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-794079e4-ee15-45fd-b5d5-bfe6f594204c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:44.388694 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-794079e4-ee15-45fd-b5d5-bfe6f594204c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:44.395942 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-794079e4-ee15-45fd-b5d5-bfe6f594204c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:44.396481 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-794079e4-ee15-45fd-b5d5-bfe6f594204c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:44.397044 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-794079e4-ee15-45fd-b5d5-bfe6f594204c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:44.397842 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-794079e4-ee15-45fd-b5d5-bfe6f594204c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:44.398360 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-794079e4-ee15-45fd-b5d5-bfe6f594204c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:44.399055 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-794079e4-ee15-45fd-b5d5-bfe6f594204c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:44.469173 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-794079e4-ee15-45fd-b5d5-bfe6f594204c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:44.477826 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-794079e4-ee15-45fd-b5d5-bfe6f594204c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.093995 Aug 24 07:54:44.478401 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 569/1131] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:44 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:54:45.515089 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-2f93cbf1-08c5-40cb-a8d6-3fea93c82338 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:45.516238 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-2f93cbf1-08c5-40cb-a8d6-3fea93c82338 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:45.520309 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_api:SELECT=28 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:45.528456 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2f93cbf1-08c5-40cb-a8d6-3fea93c82338 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:45.529431 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2f93cbf1-08c5-40cb-a8d6-3fea93c82338 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:45.530118 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2f93cbf1-08c5-40cb-a8d6-3fea93c82338 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:45.530902 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2f93cbf1-08c5-40cb-a8d6-3fea93c82338 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:45.531397 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2f93cbf1-08c5-40cb-a8d6-3fea93c82338 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:45.531944 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2f93cbf1-08c5-40cb-a8d6-3fea93c82338 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:45.536258 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell1:SELECT=84 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:45.620079 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-2f93cbf1-08c5-40cb-a8d6-3fea93c82338 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:45.634318 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-2f93cbf1-08c5-40cb-a8d6-3fea93c82338 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.125901 Aug 24 07:54:45.635452 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 563/1132] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:45 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:46.673761 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-e2ef6b33-1a12-4d96-b80a-e617be8ebca9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:46.674528 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-e2ef6b33-1a12-4d96-b80a-e617be8ebca9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:46.678402 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_api:SELECT=28 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:46.684768 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e2ef6b33-1a12-4d96-b80a-e617be8ebca9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:46.685244 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e2ef6b33-1a12-4d96-b80a-e617be8ebca9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:46.685676 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e2ef6b33-1a12-4d96-b80a-e617be8ebca9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:46.686373 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e2ef6b33-1a12-4d96-b80a-e617be8ebca9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:46.686857 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e2ef6b33-1a12-4d96-b80a-e617be8ebca9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:46.687275 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e2ef6b33-1a12-4d96-b80a-e617be8ebca9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:46.692463 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell1:SELECT=84 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:46.762674 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-e2ef6b33-1a12-4d96-b80a-e617be8ebca9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:46.771709 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-e2ef6b33-1a12-4d96-b80a-e617be8ebca9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.104587 Aug 24 07:54:46.772400 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 570/1133] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:46 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:47.794810 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-5fbaaf9e-0814-497f-a11a-4d114746ebbd tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:47.795696 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-5fbaaf9e-0814-497f-a11a-4d114746ebbd tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:47.806207 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5fbaaf9e-0814-497f-a11a-4d114746ebbd tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:47.807125 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5fbaaf9e-0814-497f-a11a-4d114746ebbd tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:47.807901 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5fbaaf9e-0814-497f-a11a-4d114746ebbd tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:47.809152 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5fbaaf9e-0814-497f-a11a-4d114746ebbd tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:47.809975 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5fbaaf9e-0814-497f-a11a-4d114746ebbd tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:47.810776 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5fbaaf9e-0814-497f-a11a-4d114746ebbd tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:47.889741 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-5fbaaf9e-0814-497f-a11a-4d114746ebbd tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:47.901174 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-5fbaaf9e-0814-497f-a11a-4d114746ebbd tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.111492 Aug 24 07:54:47.901870 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 564/1134] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:47 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:54:48.934351 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-2be784b0-8201-43f6-be09-eeb3d5979ed6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:48.935008 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-2be784b0-8201-43f6-be09-eeb3d5979ed6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:48.941796 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2be784b0-8201-43f6-be09-eeb3d5979ed6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:48.942280 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2be784b0-8201-43f6-be09-eeb3d5979ed6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:48.942738 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2be784b0-8201-43f6-be09-eeb3d5979ed6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:48.943452 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2be784b0-8201-43f6-be09-eeb3d5979ed6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:48.943902 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2be784b0-8201-43f6-be09-eeb3d5979ed6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:48.944322 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2be784b0-8201-43f6-be09-eeb3d5979ed6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:49.018211 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-2be784b0-8201-43f6-be09-eeb3d5979ed6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:49.032394 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-2be784b0-8201-43f6-be09-eeb3d5979ed6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.101846 Aug 24 07:54:49.033291 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 571/1135] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:48 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:50.063824 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-d283d3d0-d572-45fd-ab0c-160b20bda5a0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:50.064590 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-d283d3d0-d572-45fd-ab0c-160b20bda5a0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:50.072360 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d283d3d0-d572-45fd-ab0c-160b20bda5a0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:50.072867 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d283d3d0-d572-45fd-ab0c-160b20bda5a0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:50.073300 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d283d3d0-d572-45fd-ab0c-160b20bda5a0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:50.074030 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d283d3d0-d572-45fd-ab0c-160b20bda5a0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:50.074486 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d283d3d0-d572-45fd-ab0c-160b20bda5a0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:50.074941 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d283d3d0-d572-45fd-ab0c-160b20bda5a0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:50.149872 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-d283d3d0-d572-45fd-ab0c-160b20bda5a0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:50.164305 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-d283d3d0-d572-45fd-ab0c-160b20bda5a0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.103923 Aug 24 07:54:50.165349 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 565/1136] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:50 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:54:51.189732 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-fe423875-406a-4790-b111-a4ea481ffb6a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:51.193044 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-fe423875-406a-4790-b111-a4ea481ffb6a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:51.200704 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fe423875-406a-4790-b111-a4ea481ffb6a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:51.201425 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fe423875-406a-4790-b111-a4ea481ffb6a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:51.202061 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fe423875-406a-4790-b111-a4ea481ffb6a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:51.203158 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fe423875-406a-4790-b111-a4ea481ffb6a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:51.203868 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fe423875-406a-4790-b111-a4ea481ffb6a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:51.204487 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fe423875-406a-4790-b111-a4ea481ffb6a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:51.279290 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-fe423875-406a-4790-b111-a4ea481ffb6a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:51.289778 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-fe423875-406a-4790-b111-a4ea481ffb6a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.106129 Aug 24 07:54:51.290385 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 572/1137] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:51 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:52.320074 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-39da3f07-6aca-4894-b63b-4254f50e533f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:52.320784 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-39da3f07-6aca-4894-b63b-4254f50e533f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:52.330208 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-39da3f07-6aca-4894-b63b-4254f50e533f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:52.330871 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-39da3f07-6aca-4894-b63b-4254f50e533f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:52.331411 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-39da3f07-6aca-4894-b63b-4254f50e533f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:52.332209 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-39da3f07-6aca-4894-b63b-4254f50e533f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:52.332756 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-39da3f07-6aca-4894-b63b-4254f50e533f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:52.333297 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-39da3f07-6aca-4894-b63b-4254f50e533f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:52.400504 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-39da3f07-6aca-4894-b63b-4254f50e533f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:52.408293 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-39da3f07-6aca-4894-b63b-4254f50e533f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.092222 Aug 24 07:54:52.408867 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 566/1138] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:52 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:53.431867 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-d1cba9d3-ba12-43a9-a6a3-4607c589ebe0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:53.432502 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-d1cba9d3-ba12-43a9-a6a3-4607c589ebe0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:53.439160 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d1cba9d3-ba12-43a9-a6a3-4607c589ebe0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:53.439635 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d1cba9d3-ba12-43a9-a6a3-4607c589ebe0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:53.440061 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d1cba9d3-ba12-43a9-a6a3-4607c589ebe0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:53.440771 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d1cba9d3-ba12-43a9-a6a3-4607c589ebe0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:53.441212 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d1cba9d3-ba12-43a9-a6a3-4607c589ebe0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:53.441624 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d1cba9d3-ba12-43a9-a6a3-4607c589ebe0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:53.512042 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-d1cba9d3-ba12-43a9-a6a3-4607c589ebe0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:53.526673 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-d1cba9d3-ba12-43a9-a6a3-4607c589ebe0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.100402 Aug 24 07:54:53.527751 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 573/1139] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:53 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:54.557880 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-309abe79-ea6a-4ee1-91dd-12005739476b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:54.558477 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-309abe79-ea6a-4ee1-91dd-12005739476b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:54.567785 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-309abe79-ea6a-4ee1-91dd-12005739476b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:54.568271 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-309abe79-ea6a-4ee1-91dd-12005739476b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:54.568704 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-309abe79-ea6a-4ee1-91dd-12005739476b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:54.569399 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-309abe79-ea6a-4ee1-91dd-12005739476b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:54.572300 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-309abe79-ea6a-4ee1-91dd-12005739476b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:54.572879 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-309abe79-ea6a-4ee1-91dd-12005739476b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:54.637622 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-309abe79-ea6a-4ee1-91dd-12005739476b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:54.645928 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-309abe79-ea6a-4ee1-91dd-12005739476b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.091874 Aug 24 07:54:54.646492 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 567/1140] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:54 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:55.669793 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-6cd17548-875d-4304-8968-326a932ed303 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:55.670401 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-6cd17548-875d-4304-8968-326a932ed303 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:55.678592 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6cd17548-875d-4304-8968-326a932ed303 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:55.679660 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6cd17548-875d-4304-8968-326a932ed303 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:55.680079 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6cd17548-875d-4304-8968-326a932ed303 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:55.680933 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6cd17548-875d-4304-8968-326a932ed303 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:55.681396 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6cd17548-875d-4304-8968-326a932ed303 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:55.681819 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6cd17548-875d-4304-8968-326a932ed303 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:55.749268 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-6cd17548-875d-4304-8968-326a932ed303 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:55.758069 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-6cd17548-875d-4304-8968-326a932ed303 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.091512 Aug 24 07:54:55.758649 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 574/1141] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:55 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:56.783123 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-6cdedb91-cc5c-4969-9fec-be0cac5d4c87 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:56.784026 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-6cdedb91-cc5c-4969-9fec-be0cac5d4c87 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:56.791542 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6cdedb91-cc5c-4969-9fec-be0cac5d4c87 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:56.792013 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6cdedb91-cc5c-4969-9fec-be0cac5d4c87 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:56.792440 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6cdedb91-cc5c-4969-9fec-be0cac5d4c87 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:56.793128 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6cdedb91-cc5c-4969-9fec-be0cac5d4c87 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:56.793575 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6cdedb91-cc5c-4969-9fec-be0cac5d4c87 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:56.793978 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6cdedb91-cc5c-4969-9fec-be0cac5d4c87 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:56.862921 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-6cdedb91-cc5c-4969-9fec-be0cac5d4c87 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:56.871660 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-6cdedb91-cc5c-4969-9fec-be0cac5d4c87 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.095371 Aug 24 07:54:56.872252 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 568/1142] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:56 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:57.900744 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-a3217a49-d92d-4382-848a-224e023d09ad tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:57.901354 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-a3217a49-d92d-4382-848a-224e023d09ad tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:57.909384 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a3217a49-d92d-4382-848a-224e023d09ad tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:57.909869 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a3217a49-d92d-4382-848a-224e023d09ad tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:57.910296 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a3217a49-d92d-4382-848a-224e023d09ad tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:57.911020 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a3217a49-d92d-4382-848a-224e023d09ad tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:57.911471 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a3217a49-d92d-4382-848a-224e023d09ad tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:57.911886 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a3217a49-d92d-4382-848a-224e023d09ad tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:57.995363 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-a3217a49-d92d-4382-848a-224e023d09ad tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:58.004284 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-a3217a49-d92d-4382-848a-224e023d09ad tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.108450 Aug 24 07:54:58.004963 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 575/1143] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:57 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:54:59.028940 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-20ec9820-c70e-4219-b885-3bd830ae7918 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:54:59.030045 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-20ec9820-c70e-4219-b885-3bd830ae7918 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:54:59.043026 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-20ec9820-c70e-4219-b885-3bd830ae7918 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:59.043881 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-20ec9820-c70e-4219-b885-3bd830ae7918 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:59.044632 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-20ec9820-c70e-4219-b885-3bd830ae7918 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:59.045879 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-20ec9820-c70e-4219-b885-3bd830ae7918 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:54:59.046809 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-20ec9820-c70e-4219-b885-3bd830ae7918 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:54:59.047539 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-20ec9820-c70e-4219-b885-3bd830ae7918 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:54:59.132982 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-20ec9820-c70e-4219-b885-3bd830ae7918 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:54:59.141475 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-20ec9820-c70e-4219-b885-3bd830ae7918 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.119656 Aug 24 07:54:59.142053 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 569/1144] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:54:59 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:55:00.168471 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-a81e1948-bfa5-4b6c-bba3-979b0f5f1bee tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:00.169499 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-a81e1948-bfa5-4b6c-bba3-979b0f5f1bee tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:00.180178 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a81e1948-bfa5-4b6c-bba3-979b0f5f1bee tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:00.180674 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a81e1948-bfa5-4b6c-bba3-979b0f5f1bee tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:00.181105 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a81e1948-bfa5-4b6c-bba3-979b0f5f1bee tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:00.181792 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a81e1948-bfa5-4b6c-bba3-979b0f5f1bee tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:00.182239 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a81e1948-bfa5-4b6c-bba3-979b0f5f1bee tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:00.182656 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a81e1948-bfa5-4b6c-bba3-979b0f5f1bee tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:00.249224 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-a81e1948-bfa5-4b6c-bba3-979b0f5f1bee tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:00.263029 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-a81e1948-bfa5-4b6c-bba3-979b0f5f1bee tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.101211 Aug 24 07:55:00.263987 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 576/1145] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:00 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:01.298471 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-da7f75df-a1a6-4ed2-8f32-30560758b6b4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:01.298471 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-da7f75df-a1a6-4ed2-8f32-30560758b6b4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:01.305275 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-da7f75df-a1a6-4ed2-8f32-30560758b6b4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:01.305772 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-da7f75df-a1a6-4ed2-8f32-30560758b6b4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:01.308471 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-da7f75df-a1a6-4ed2-8f32-30560758b6b4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:01.308471 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-da7f75df-a1a6-4ed2-8f32-30560758b6b4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:01.308471 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-da7f75df-a1a6-4ed2-8f32-30560758b6b4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:01.312443 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-da7f75df-a1a6-4ed2-8f32-30560758b6b4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:01.401935 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-da7f75df-a1a6-4ed2-8f32-30560758b6b4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:01.414381 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-da7f75df-a1a6-4ed2-8f32-30560758b6b4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.121933 Aug 24 07:55:01.415387 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 570/1146] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:01 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:55:02.437113 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-04403e5a-923e-4f97-a006-2167d69af67c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:02.437690 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-04403e5a-923e-4f97-a006-2167d69af67c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:02.446244 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-04403e5a-923e-4f97-a006-2167d69af67c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:02.447122 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-04403e5a-923e-4f97-a006-2167d69af67c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:02.447814 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-04403e5a-923e-4f97-a006-2167d69af67c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:02.448917 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-04403e5a-923e-4f97-a006-2167d69af67c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:02.449759 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-04403e5a-923e-4f97-a006-2167d69af67c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:02.450256 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-04403e5a-923e-4f97-a006-2167d69af67c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:02.530462 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-04403e5a-923e-4f97-a006-2167d69af67c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:02.539913 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-04403e5a-923e-4f97-a006-2167d69af67c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.106623 Aug 24 07:55:02.540562 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 577/1147] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:02 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:55:03.561546 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-3af7b426-2f32-42a7-81d2-d31438aaef31 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:03.562296 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-3af7b426-2f32-42a7-81d2-d31438aaef31 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:03.569133 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3af7b426-2f32-42a7-81d2-d31438aaef31 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:03.569646 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3af7b426-2f32-42a7-81d2-d31438aaef31 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:03.570595 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3af7b426-2f32-42a7-81d2-d31438aaef31 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:03.571336 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3af7b426-2f32-42a7-81d2-d31438aaef31 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:03.571917 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3af7b426-2f32-42a7-81d2-d31438aaef31 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:03.576008 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3af7b426-2f32-42a7-81d2-d31438aaef31 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:03.643239 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-3af7b426-2f32-42a7-81d2-d31438aaef31 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:03.656922 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-3af7b426-2f32-42a7-81d2-d31438aaef31 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.098993 Aug 24 07:55:03.658154 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 571/1148] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:03 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:55:04.681758 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-e49dbd69-27ef-408c-ba7f-7b1409aaa3c2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:04.682815 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-e49dbd69-27ef-408c-ba7f-7b1409aaa3c2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:04.690271 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e49dbd69-27ef-408c-ba7f-7b1409aaa3c2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:04.690951 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e49dbd69-27ef-408c-ba7f-7b1409aaa3c2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:04.691501 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e49dbd69-27ef-408c-ba7f-7b1409aaa3c2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:04.692314 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e49dbd69-27ef-408c-ba7f-7b1409aaa3c2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:04.692868 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e49dbd69-27ef-408c-ba7f-7b1409aaa3c2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:04.693389 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e49dbd69-27ef-408c-ba7f-7b1409aaa3c2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:04.777841 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-e49dbd69-27ef-408c-ba7f-7b1409aaa3c2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:04.791771 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-e49dbd69-27ef-408c-ba7f-7b1409aaa3c2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.114611 Aug 24 07:55:04.792774 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 578/1149] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:04 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:55:05.828990 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-4d58d637-b73d-40ab-8c3e-0bf151a78ad5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:05.829887 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-4d58d637-b73d-40ab-8c3e-0bf151a78ad5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:05.840598 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4d58d637-b73d-40ab-8c3e-0bf151a78ad5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:05.841199 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4d58d637-b73d-40ab-8c3e-0bf151a78ad5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:05.841824 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4d58d637-b73d-40ab-8c3e-0bf151a78ad5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:05.842884 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4d58d637-b73d-40ab-8c3e-0bf151a78ad5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:05.843543 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4d58d637-b73d-40ab-8c3e-0bf151a78ad5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:05.844154 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4d58d637-b73d-40ab-8c3e-0bf151a78ad5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:06.090904 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-4d58d637-b73d-40ab-8c3e-0bf151a78ad5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:06.107128 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-4d58d637-b73d-40ab-8c3e-0bf151a78ad5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.283632 Aug 24 07:55:06.108096 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 572/1150] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:05 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:07.141256 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-f07dd935-c7f9-4b16-b42e-fe6ddcee2ba0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:07.142211 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-f07dd935-c7f9-4b16-b42e-fe6ddcee2ba0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:07.153722 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f07dd935-c7f9-4b16-b42e-fe6ddcee2ba0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:07.154476 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f07dd935-c7f9-4b16-b42e-fe6ddcee2ba0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:07.155192 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f07dd935-c7f9-4b16-b42e-fe6ddcee2ba0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:07.156348 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f07dd935-c7f9-4b16-b42e-fe6ddcee2ba0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:07.157079 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f07dd935-c7f9-4b16-b42e-fe6ddcee2ba0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:07.157780 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f07dd935-c7f9-4b16-b42e-fe6ddcee2ba0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:07.253301 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-f07dd935-c7f9-4b16-b42e-fe6ddcee2ba0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:07.266143 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-f07dd935-c7f9-4b16-b42e-fe6ddcee2ba0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.130831 Aug 24 07:55:07.266996 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 579/1151] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:07 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:08.291871 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-02f38832-00df-4b31-8bfc-4782dd3fdcdd tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:08.292677 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-02f38832-00df-4b31-8bfc-4782dd3fdcdd tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:08.303406 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-02f38832-00df-4b31-8bfc-4782dd3fdcdd tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:08.304244 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-02f38832-00df-4b31-8bfc-4782dd3fdcdd tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:08.304909 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-02f38832-00df-4b31-8bfc-4782dd3fdcdd tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:08.306248 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-02f38832-00df-4b31-8bfc-4782dd3fdcdd tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:08.307107 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-02f38832-00df-4b31-8bfc-4782dd3fdcdd tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:08.307759 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-02f38832-00df-4b31-8bfc-4782dd3fdcdd tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:08.398686 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-02f38832-00df-4b31-8bfc-4782dd3fdcdd tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:08.409317 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-02f38832-00df-4b31-8bfc-4782dd3fdcdd tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.124657 Aug 24 07:55:08.410116 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 573/1152] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:08 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:09.435511 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-d280f37e-0d43-42f3-a3c5-6c4329252058 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:09.436381 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-d280f37e-0d43-42f3-a3c5-6c4329252058 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:09.443208 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d280f37e-0d43-42f3-a3c5-6c4329252058 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:09.443692 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d280f37e-0d43-42f3-a3c5-6c4329252058 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:09.444123 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d280f37e-0d43-42f3-a3c5-6c4329252058 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:09.444876 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d280f37e-0d43-42f3-a3c5-6c4329252058 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:09.445329 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d280f37e-0d43-42f3-a3c5-6c4329252058 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:09.445778 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d280f37e-0d43-42f3-a3c5-6c4329252058 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:09.603055 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-d280f37e-0d43-42f3-a3c5-6c4329252058 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:09.617623 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-d280f37e-0d43-42f3-a3c5-6c4329252058 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.186519 Aug 24 07:55:09.618666 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 580/1153] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:09 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:55:10.653201 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-6fbc7df1-4cc5-4089-a46a-9395c351e19a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:10.654160 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-6fbc7df1-4cc5-4089-a46a-9395c351e19a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:10.665613 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6fbc7df1-4cc5-4089-a46a-9395c351e19a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:10.666419 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6fbc7df1-4cc5-4089-a46a-9395c351e19a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:10.667322 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6fbc7df1-4cc5-4089-a46a-9395c351e19a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:10.668432 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6fbc7df1-4cc5-4089-a46a-9395c351e19a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:10.669273 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6fbc7df1-4cc5-4089-a46a-9395c351e19a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:10.670050 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6fbc7df1-4cc5-4089-a46a-9395c351e19a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:10.768224 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-6fbc7df1-4cc5-4089-a46a-9395c351e19a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:10.782053 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-6fbc7df1-4cc5-4089-a46a-9395c351e19a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.134271 Aug 24 07:55:10.783117 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 574/1154] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:10 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:11.808710 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-3fefcc3c-353d-454f-ae80-0dd407c61a6c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:11.809837 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-3fefcc3c-353d-454f-ae80-0dd407c61a6c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:11.817907 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3fefcc3c-353d-454f-ae80-0dd407c61a6c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:11.818767 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3fefcc3c-353d-454f-ae80-0dd407c61a6c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:11.819527 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3fefcc3c-353d-454f-ae80-0dd407c61a6c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:11.821279 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3fefcc3c-353d-454f-ae80-0dd407c61a6c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:11.822128 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3fefcc3c-353d-454f-ae80-0dd407c61a6c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:11.822916 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3fefcc3c-353d-454f-ae80-0dd407c61a6c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:11.908038 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-3fefcc3c-353d-454f-ae80-0dd407c61a6c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:11.918792 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-3fefcc3c-353d-454f-ae80-0dd407c61a6c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.117256 Aug 24 07:55:11.919378 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 581/1155] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:11 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:12.881899 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 07:55:12.882551 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Wed Aug 24 07:55:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 07:55:12.940126 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-6ac8ba91-9f8e-4309-8d57-04458e393f9d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:12.940729 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-6ac8ba91-9f8e-4309-8d57-04458e393f9d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:12.948719 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6ac8ba91-9f8e-4309-8d57-04458e393f9d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:12.949242 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6ac8ba91-9f8e-4309-8d57-04458e393f9d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:12.949768 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6ac8ba91-9f8e-4309-8d57-04458e393f9d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:12.951331 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6ac8ba91-9f8e-4309-8d57-04458e393f9d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:12.951782 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6ac8ba91-9f8e-4309-8d57-04458e393f9d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:12.952204 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6ac8ba91-9f8e-4309-8d57-04458e393f9d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:13.036657 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-6ac8ba91-9f8e-4309-8d57-04458e393f9d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:13.049174 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-6ac8ba91-9f8e-4309-8d57-04458e393f9d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.112679 Aug 24 07:55:13.050076 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 575/1156] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:12 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:14.082370 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-321aaa57-cf14-42fc-a1be-ea56fdca1f0e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:14.083326 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-321aaa57-cf14-42fc-a1be-ea56fdca1f0e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:14.089601 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-321aaa57-cf14-42fc-a1be-ea56fdca1f0e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:14.090081 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-321aaa57-cf14-42fc-a1be-ea56fdca1f0e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:14.090516 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-321aaa57-cf14-42fc-a1be-ea56fdca1f0e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:14.091238 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-321aaa57-cf14-42fc-a1be-ea56fdca1f0e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:14.091690 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-321aaa57-cf14-42fc-a1be-ea56fdca1f0e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:14.092110 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-321aaa57-cf14-42fc-a1be-ea56fdca1f0e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:14.163607 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-321aaa57-cf14-42fc-a1be-ea56fdca1f0e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:14.176729 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-321aaa57-cf14-42fc-a1be-ea56fdca1f0e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.098016 Aug 24 07:55:14.178077 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 582/1157] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:14 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:15.205108 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-031a7740-a951-4515-b1ea-e2c9e5442b9d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:15.205760 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-031a7740-a951-4515-b1ea-e2c9e5442b9d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:15.218296 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-031a7740-a951-4515-b1ea-e2c9e5442b9d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:15.219155 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-031a7740-a951-4515-b1ea-e2c9e5442b9d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:15.219895 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-031a7740-a951-4515-b1ea-e2c9e5442b9d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:15.220795 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-031a7740-a951-4515-b1ea-e2c9e5442b9d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:15.221513 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-031a7740-a951-4515-b1ea-e2c9e5442b9d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:15.222061 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-031a7740-a951-4515-b1ea-e2c9e5442b9d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:15.306783 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-031a7740-a951-4515-b1ea-e2c9e5442b9d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:15.316094 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-031a7740-a951-4515-b1ea-e2c9e5442b9d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.117032 Aug 24 07:55:15.316679 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 576/1158] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:15 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:16.338379 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-82dbaf17-b334-4aa5-8d96-4b0b3699f730 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:16.339012 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-82dbaf17-b334-4aa5-8d96-4b0b3699f730 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:16.346057 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-82dbaf17-b334-4aa5-8d96-4b0b3699f730 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:16.346533 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-82dbaf17-b334-4aa5-8d96-4b0b3699f730 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:16.346996 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-82dbaf17-b334-4aa5-8d96-4b0b3699f730 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:16.347696 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-82dbaf17-b334-4aa5-8d96-4b0b3699f730 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:16.348147 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-82dbaf17-b334-4aa5-8d96-4b0b3699f730 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:16.348589 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-82dbaf17-b334-4aa5-8d96-4b0b3699f730 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:16.440843 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-82dbaf17-b334-4aa5-8d96-4b0b3699f730 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:16.452872 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-82dbaf17-b334-4aa5-8d96-4b0b3699f730 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.118209 Aug 24 07:55:16.453521 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 583/1159] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:16 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:55:17.477632 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-2a5901f4-9619-4744-ab86-ac130e625b0c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:17.478550 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-2a5901f4-9619-4744-ab86-ac130e625b0c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:17.480593 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_api:SELECT=28 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:17.486158 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2a5901f4-9619-4744-ab86-ac130e625b0c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:17.486639 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2a5901f4-9619-4744-ab86-ac130e625b0c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:17.487112 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2a5901f4-9619-4744-ab86-ac130e625b0c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:17.487822 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2a5901f4-9619-4744-ab86-ac130e625b0c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:17.488321 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2a5901f4-9619-4744-ab86-ac130e625b0c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:17.488825 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-2a5901f4-9619-4744-ab86-ac130e625b0c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:17.492531 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell1:SELECT=84 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:17.567776 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-2a5901f4-9619-4744-ab86-ac130e625b0c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:17.579194 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-2a5901f4-9619-4744-ab86-ac130e625b0c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.105807 Aug 24 07:55:17.580087 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 577/1160] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:17 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:18.607584 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-2fd9671f-3385-42cd-9757-59f134cf3078 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:18.608712 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-2fd9671f-3385-42cd-9757-59f134cf3078 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:18.612482 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_api:SELECT=28 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:18.619831 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2fd9671f-3385-42cd-9757-59f134cf3078 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:18.620592 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2fd9671f-3385-42cd-9757-59f134cf3078 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:18.621247 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2fd9671f-3385-42cd-9757-59f134cf3078 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:18.622087 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2fd9671f-3385-42cd-9757-59f134cf3078 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:18.622645 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2fd9671f-3385-42cd-9757-59f134cf3078 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:18.623297 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2fd9671f-3385-42cd-9757-59f134cf3078 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:18.627279 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell1:SELECT=84 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:18.707708 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-2fd9671f-3385-42cd-9757-59f134cf3078 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:18.721262 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-2fd9671f-3385-42cd-9757-59f134cf3078 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.120991 Aug 24 07:55:18.722286 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 584/1161] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:18 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:19.749129 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-50e2de07-86a7-4f7a-8007-798e94a738db tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:19.749962 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-50e2de07-86a7-4f7a-8007-798e94a738db tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:19.756768 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-50e2de07-86a7-4f7a-8007-798e94a738db tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:19.757247 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-50e2de07-86a7-4f7a-8007-798e94a738db tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:19.758239 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-50e2de07-86a7-4f7a-8007-798e94a738db tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:19.759009 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-50e2de07-86a7-4f7a-8007-798e94a738db tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:19.759470 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-50e2de07-86a7-4f7a-8007-798e94a738db tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:19.759890 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-50e2de07-86a7-4f7a-8007-798e94a738db tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:19.833937 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-50e2de07-86a7-4f7a-8007-798e94a738db tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:19.843195 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-50e2de07-86a7-4f7a-8007-798e94a738db tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.098060 Aug 24 07:55:19.843923 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 578/1162] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:19 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:20.864471 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-cfb2cf78-a99a-468b-91c3-261b79efe1df tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:20.865240 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-cfb2cf78-a99a-468b-91c3-261b79efe1df tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:20.872760 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cfb2cf78-a99a-468b-91c3-261b79efe1df tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:20.873231 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cfb2cf78-a99a-468b-91c3-261b79efe1df tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:20.873652 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cfb2cf78-a99a-468b-91c3-261b79efe1df tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:20.874331 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cfb2cf78-a99a-468b-91c3-261b79efe1df tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:20.874879 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cfb2cf78-a99a-468b-91c3-261b79efe1df tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:20.875292 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cfb2cf78-a99a-468b-91c3-261b79efe1df tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:20.943408 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-cfb2cf78-a99a-468b-91c3-261b79efe1df tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:20.951668 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-cfb2cf78-a99a-468b-91c3-261b79efe1df tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.091053 Aug 24 07:55:20.952255 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 585/1163] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:20 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:21.210450 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 07:55:21.211230 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Wed Aug 24 07:55:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 07:55:21.571094 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 07:55:21.571373 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Wed Aug 24 07:55:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 07:55:21.973656 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-0feb3d8a-32d1-4c79-96e6-198caafd710e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:21.974258 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-0feb3d8a-32d1-4c79-96e6-198caafd710e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:21.981655 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0feb3d8a-32d1-4c79-96e6-198caafd710e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:21.982151 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0feb3d8a-32d1-4c79-96e6-198caafd710e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:21.982612 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0feb3d8a-32d1-4c79-96e6-198caafd710e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:21.983327 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0feb3d8a-32d1-4c79-96e6-198caafd710e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:21.983772 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0feb3d8a-32d1-4c79-96e6-198caafd710e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:21.984184 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0feb3d8a-32d1-4c79-96e6-198caafd710e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:22.053540 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-0feb3d8a-32d1-4c79-96e6-198caafd710e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:22.062161 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-0feb3d8a-32d1-4c79-96e6-198caafd710e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.091975 Aug 24 07:55:22.062802 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 579/1164] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:21 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:23.087014 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-07a8e503-e931-4818-b57b-704986ed4d93 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:23.087834 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-07a8e503-e931-4818-b57b-704986ed4d93 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:23.094285 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-07a8e503-e931-4818-b57b-704986ed4d93 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:23.094977 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-07a8e503-e931-4818-b57b-704986ed4d93 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:23.095545 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-07a8e503-e931-4818-b57b-704986ed4d93 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:23.096342 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-07a8e503-e931-4818-b57b-704986ed4d93 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:23.096895 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-07a8e503-e931-4818-b57b-704986ed4d93 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:23.097433 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-07a8e503-e931-4818-b57b-704986ed4d93 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:23.168009 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-07a8e503-e931-4818-b57b-704986ed4d93 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:23.175957 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-07a8e503-e931-4818-b57b-704986ed4d93 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.092931 Aug 24 07:55:23.176534 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 586/1165] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:23 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:24.206150 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-fcd141cf-5ec0-4d85-93df-a38a46826de2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:24.206797 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-fcd141cf-5ec0-4d85-93df-a38a46826de2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:24.214398 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-fcd141cf-5ec0-4d85-93df-a38a46826de2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:24.214925 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-fcd141cf-5ec0-4d85-93df-a38a46826de2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:24.215358 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-fcd141cf-5ec0-4d85-93df-a38a46826de2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:24.216062 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-fcd141cf-5ec0-4d85-93df-a38a46826de2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:24.216512 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-fcd141cf-5ec0-4d85-93df-a38a46826de2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:24.216930 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-fcd141cf-5ec0-4d85-93df-a38a46826de2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:24.282252 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-fcd141cf-5ec0-4d85-93df-a38a46826de2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:24.290846 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-fcd141cf-5ec0-4d85-93df-a38a46826de2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.088352 Aug 24 07:55:24.291584 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 580/1166] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:24 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:55:25.312710 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-8554bd0f-a8ad-4add-9cef-eaa45a8c6fb2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:25.313647 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-8554bd0f-a8ad-4add-9cef-eaa45a8c6fb2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:25.321140 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8554bd0f-a8ad-4add-9cef-eaa45a8c6fb2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:25.321140 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8554bd0f-a8ad-4add-9cef-eaa45a8c6fb2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:25.321697 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8554bd0f-a8ad-4add-9cef-eaa45a8c6fb2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:25.322403 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8554bd0f-a8ad-4add-9cef-eaa45a8c6fb2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:25.322926 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8554bd0f-a8ad-4add-9cef-eaa45a8c6fb2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:25.323345 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8554bd0f-a8ad-4add-9cef-eaa45a8c6fb2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:25.411944 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-8554bd0f-a8ad-4add-9cef-eaa45a8c6fb2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:25.420473 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-8554bd0f-a8ad-4add-9cef-eaa45a8c6fb2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.111953 Aug 24 07:55:25.421048 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 587/1167] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:25 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:26.442811 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-c8d5b538-ff7c-4328-864c-e574c3bd5263 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:26.443493 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-c8d5b538-ff7c-4328-864c-e574c3bd5263 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:26.451306 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c8d5b538-ff7c-4328-864c-e574c3bd5263 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:26.451794 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c8d5b538-ff7c-4328-864c-e574c3bd5263 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:26.452228 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c8d5b538-ff7c-4328-864c-e574c3bd5263 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:26.452947 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c8d5b538-ff7c-4328-864c-e574c3bd5263 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:26.453400 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c8d5b538-ff7c-4328-864c-e574c3bd5263 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:26.453827 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c8d5b538-ff7c-4328-864c-e574c3bd5263 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:26.533206 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-c8d5b538-ff7c-4328-864c-e574c3bd5263 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:26.541805 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-c8d5b538-ff7c-4328-864c-e574c3bd5263 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.102866 Aug 24 07:55:26.542380 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 581/1168] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:26 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:55:27.566136 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-f83e9aae-0653-4f1f-b701-d8a9998754c8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:27.566753 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-f83e9aae-0653-4f1f-b701-d8a9998754c8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:27.575539 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f83e9aae-0653-4f1f-b701-d8a9998754c8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:27.576021 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f83e9aae-0653-4f1f-b701-d8a9998754c8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:27.576454 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f83e9aae-0653-4f1f-b701-d8a9998754c8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:27.577150 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f83e9aae-0653-4f1f-b701-d8a9998754c8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:27.577596 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f83e9aae-0653-4f1f-b701-d8a9998754c8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:27.578044 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f83e9aae-0653-4f1f-b701-d8a9998754c8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:27.656745 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-f83e9aae-0653-4f1f-b701-d8a9998754c8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:27.665866 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-f83e9aae-0653-4f1f-b701-d8a9998754c8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.103563 Aug 24 07:55:27.667099 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 588/1169] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:27 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:28.699183 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-8ab04b2b-b36a-4e28-a232-8ceb4272f03e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:28.700024 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-8ab04b2b-b36a-4e28-a232-8ceb4272f03e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:28.709289 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8ab04b2b-b36a-4e28-a232-8ceb4272f03e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:28.709952 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8ab04b2b-b36a-4e28-a232-8ceb4272f03e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:28.710763 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8ab04b2b-b36a-4e28-a232-8ceb4272f03e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:28.712096 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8ab04b2b-b36a-4e28-a232-8ceb4272f03e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:28.713064 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8ab04b2b-b36a-4e28-a232-8ceb4272f03e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:28.713778 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-8ab04b2b-b36a-4e28-a232-8ceb4272f03e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:28.799047 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-8ab04b2b-b36a-4e28-a232-8ceb4272f03e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:28.808079 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-8ab04b2b-b36a-4e28-a232-8ceb4272f03e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.114681 Aug 24 07:55:28.808650 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 582/1170] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:28 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:55:29.829560 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-dfb2fd3e-d423-449a-ac9e-d329ac3fb8ed tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:29.830357 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-dfb2fd3e-d423-449a-ac9e-d329ac3fb8ed tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:29.837902 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-dfb2fd3e-d423-449a-ac9e-d329ac3fb8ed tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:29.838390 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-dfb2fd3e-d423-449a-ac9e-d329ac3fb8ed tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:29.838860 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-dfb2fd3e-d423-449a-ac9e-d329ac3fb8ed tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:29.839571 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-dfb2fd3e-d423-449a-ac9e-d329ac3fb8ed tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:29.840025 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-dfb2fd3e-d423-449a-ac9e-d329ac3fb8ed tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:29.840450 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-dfb2fd3e-d423-449a-ac9e-d329ac3fb8ed tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:29.906088 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-dfb2fd3e-d423-449a-ac9e-d329ac3fb8ed tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:29.914908 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-dfb2fd3e-d423-449a-ac9e-d329ac3fb8ed tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.089623 Aug 24 07:55:29.915467 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 589/1171] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:29 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:55:30.942796 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-eb368615-be00-4241-b372-5219b8e3a3ec tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:30.945108 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-eb368615-be00-4241-b372-5219b8e3a3ec tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:30.952564 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-eb368615-be00-4241-b372-5219b8e3a3ec tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:30.953045 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-eb368615-be00-4241-b372-5219b8e3a3ec tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:30.953503 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-eb368615-be00-4241-b372-5219b8e3a3ec tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:30.954209 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-eb368615-be00-4241-b372-5219b8e3a3ec tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:30.954655 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-eb368615-be00-4241-b372-5219b8e3a3ec tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:30.955106 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-eb368615-be00-4241-b372-5219b8e3a3ec tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:31.028026 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-eb368615-be00-4241-b372-5219b8e3a3ec tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:31.036421 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-eb368615-be00-4241-b372-5219b8e3a3ec tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.102383 Aug 24 07:55:31.037086 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 583/1172] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:30 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:32.058463 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-4924f2bc-f5f5-4315-8b2b-e3601cefc7d8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:32.059183 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-4924f2bc-f5f5-4315-8b2b-e3601cefc7d8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:32.067000 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4924f2bc-f5f5-4315-8b2b-e3601cefc7d8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:32.067483 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4924f2bc-f5f5-4315-8b2b-e3601cefc7d8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:32.067918 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4924f2bc-f5f5-4315-8b2b-e3601cefc7d8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:32.068618 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4924f2bc-f5f5-4315-8b2b-e3601cefc7d8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:32.069067 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4924f2bc-f5f5-4315-8b2b-e3601cefc7d8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:32.069493 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4924f2bc-f5f5-4315-8b2b-e3601cefc7d8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:32.140005 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-4924f2bc-f5f5-4315-8b2b-e3601cefc7d8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:32.148807 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-4924f2bc-f5f5-4315-8b2b-e3601cefc7d8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.094236 Aug 24 07:55:32.149442 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 590/1173] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:32 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:55:33.174796 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-c37fc20c-078c-498f-bac1-1acf226e165c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:33.175890 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-c37fc20c-078c-498f-bac1-1acf226e165c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:33.186714 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c37fc20c-078c-498f-bac1-1acf226e165c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:33.187211 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c37fc20c-078c-498f-bac1-1acf226e165c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:33.187646 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c37fc20c-078c-498f-bac1-1acf226e165c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:33.188358 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c37fc20c-078c-498f-bac1-1acf226e165c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:33.188811 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c37fc20c-078c-498f-bac1-1acf226e165c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:33.189292 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c37fc20c-078c-498f-bac1-1acf226e165c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:33.259533 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-c37fc20c-078c-498f-bac1-1acf226e165c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:33.268299 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-c37fc20c-078c-498f-bac1-1acf226e165c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.100842 Aug 24 07:55:33.268876 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 584/1174] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:33 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:34.292567 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-d278afdf-b027-41a2-88a0-e8d217923427 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:34.293651 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-d278afdf-b027-41a2-88a0-e8d217923427 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:34.304789 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d278afdf-b027-41a2-88a0-e8d217923427 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:34.305615 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d278afdf-b027-41a2-88a0-e8d217923427 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:34.306331 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d278afdf-b027-41a2-88a0-e8d217923427 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:34.307571 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d278afdf-b027-41a2-88a0-e8d217923427 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:34.308336 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d278afdf-b027-41a2-88a0-e8d217923427 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:34.308986 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d278afdf-b027-41a2-88a0-e8d217923427 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:34.385853 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-d278afdf-b027-41a2-88a0-e8d217923427 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:34.394403 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-d278afdf-b027-41a2-88a0-e8d217923427 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.108865 Aug 24 07:55:34.395018 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 591/1175] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:34 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:35.417303 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-a74700d7-61bf-47d3-83ce-d62a6ece3e1a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:35.418093 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-a74700d7-61bf-47d3-83ce-d62a6ece3e1a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:35.424438 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a74700d7-61bf-47d3-83ce-d62a6ece3e1a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:35.424906 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a74700d7-61bf-47d3-83ce-d62a6ece3e1a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:35.425332 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a74700d7-61bf-47d3-83ce-d62a6ece3e1a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:35.426144 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a74700d7-61bf-47d3-83ce-d62a6ece3e1a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:35.426746 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a74700d7-61bf-47d3-83ce-d62a6ece3e1a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:35.427168 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a74700d7-61bf-47d3-83ce-d62a6ece3e1a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:35.495094 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-a74700d7-61bf-47d3-83ce-d62a6ece3e1a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:35.503011 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-a74700d7-61bf-47d3-83ce-d62a6ece3e1a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.089529 Aug 24 07:55:35.503569 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 585/1176] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:35 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:36.212582 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 07:55:36.213331 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Wed Aug 24 07:55:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 07:55:36.526139 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-83457a93-1f49-4276-92bc-59a83dfc7eb7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:36.526646 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-83457a93-1f49-4276-92bc-59a83dfc7eb7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:36.534656 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-83457a93-1f49-4276-92bc-59a83dfc7eb7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:36.535172 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-83457a93-1f49-4276-92bc-59a83dfc7eb7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:36.535608 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-83457a93-1f49-4276-92bc-59a83dfc7eb7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:36.536312 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-83457a93-1f49-4276-92bc-59a83dfc7eb7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:36.536761 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-83457a93-1f49-4276-92bc-59a83dfc7eb7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:36.537175 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-83457a93-1f49-4276-92bc-59a83dfc7eb7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:36.616534 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-83457a93-1f49-4276-92bc-59a83dfc7eb7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:36.626524 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-83457a93-1f49-4276-92bc-59a83dfc7eb7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.105327 Aug 24 07:55:36.627153 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 592/1177] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:36 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:37.518126 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 07:55:37.519010 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Wed Aug 24 07:55:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 07:55:37.650106 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-e0c6cebe-a52c-41b3-9444-6b91792e4c5c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:37.651121 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-e0c6cebe-a52c-41b3-9444-6b91792e4c5c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:37.658742 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e0c6cebe-a52c-41b3-9444-6b91792e4c5c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:37.659215 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e0c6cebe-a52c-41b3-9444-6b91792e4c5c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:37.659649 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e0c6cebe-a52c-41b3-9444-6b91792e4c5c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:37.660333 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e0c6cebe-a52c-41b3-9444-6b91792e4c5c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:37.660780 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e0c6cebe-a52c-41b3-9444-6b91792e4c5c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:37.661195 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e0c6cebe-a52c-41b3-9444-6b91792e4c5c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:37.738126 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-e0c6cebe-a52c-41b3-9444-6b91792e4c5c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:37.750273 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-e0c6cebe-a52c-41b3-9444-6b91792e4c5c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.106053 Aug 24 07:55:37.750867 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 586/1178] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:37 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:38.773875 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-521c2ece-b545-488c-b5cc-8fba624e8b6e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:38.774831 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-521c2ece-b545-488c-b5cc-8fba624e8b6e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:38.783201 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-521c2ece-b545-488c-b5cc-8fba624e8b6e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:38.783733 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-521c2ece-b545-488c-b5cc-8fba624e8b6e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:38.784206 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-521c2ece-b545-488c-b5cc-8fba624e8b6e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:38.784964 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-521c2ece-b545-488c-b5cc-8fba624e8b6e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:38.785538 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-521c2ece-b545-488c-b5cc-8fba624e8b6e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:38.786009 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-521c2ece-b545-488c-b5cc-8fba624e8b6e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:38.859672 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-521c2ece-b545-488c-b5cc-8fba624e8b6e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:38.868938 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-521c2ece-b545-488c-b5cc-8fba624e8b6e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.100872 Aug 24 07:55:38.869520 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 593/1179] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:38 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:39.891013 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-66d7df0e-a4c4-4922-a44a-df2c7cae2e21 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:39.891618 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-66d7df0e-a4c4-4922-a44a-df2c7cae2e21 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:39.898885 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-66d7df0e-a4c4-4922-a44a-df2c7cae2e21 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:39.899373 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-66d7df0e-a4c4-4922-a44a-df2c7cae2e21 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:39.899798 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-66d7df0e-a4c4-4922-a44a-df2c7cae2e21 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:39.900498 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-66d7df0e-a4c4-4922-a44a-df2c7cae2e21 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:39.900941 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-66d7df0e-a4c4-4922-a44a-df2c7cae2e21 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:39.901359 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-66d7df0e-a4c4-4922-a44a-df2c7cae2e21 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:39.966724 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-66d7df0e-a4c4-4922-a44a-df2c7cae2e21 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:39.974756 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-66d7df0e-a4c4-4922-a44a-df2c7cae2e21 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.087731 Aug 24 07:55:39.975324 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 587/1180] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:39 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:40.998563 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-1c0eade9-a0a4-48b7-8a5a-a7431c495ff7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:40.999371 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-1c0eade9-a0a4-48b7-8a5a-a7431c495ff7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:41.006327 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1c0eade9-a0a4-48b7-8a5a-a7431c495ff7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:41.006920 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1c0eade9-a0a4-48b7-8a5a-a7431c495ff7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:41.007395 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1c0eade9-a0a4-48b7-8a5a-a7431c495ff7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:41.008139 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1c0eade9-a0a4-48b7-8a5a-a7431c495ff7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:41.008635 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1c0eade9-a0a4-48b7-8a5a-a7431c495ff7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:41.009102 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1c0eade9-a0a4-48b7-8a5a-a7431c495ff7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:41.079489 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-1c0eade9-a0a4-48b7-8a5a-a7431c495ff7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:41.090135 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-1c0eade9-a0a4-48b7-8a5a-a7431c495ff7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.095975 Aug 24 07:55:41.090803 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 594/1181] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:40 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:42.123167 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-5a149e11-554a-4938-9da1-48db25379739 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:42.124045 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-5a149e11-554a-4938-9da1-48db25379739 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:42.133265 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5a149e11-554a-4938-9da1-48db25379739 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:42.133757 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5a149e11-554a-4938-9da1-48db25379739 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:42.134238 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5a149e11-554a-4938-9da1-48db25379739 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:42.135063 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5a149e11-554a-4938-9da1-48db25379739 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:42.135574 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5a149e11-554a-4938-9da1-48db25379739 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:42.136006 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5a149e11-554a-4938-9da1-48db25379739 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:42.205940 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-5a149e11-554a-4938-9da1-48db25379739 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:42.213805 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-5a149e11-554a-4938-9da1-48db25379739 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.097653 Aug 24 07:55:42.214377 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 588/1182] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:42 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:43.234963 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-d1c7d397-caba-4e64-9a35-a68c403135d4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:43.235566 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-d1c7d397-caba-4e64-9a35-a68c403135d4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:43.242727 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d1c7d397-caba-4e64-9a35-a68c403135d4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:43.243228 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d1c7d397-caba-4e64-9a35-a68c403135d4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:43.243639 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d1c7d397-caba-4e64-9a35-a68c403135d4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:43.244330 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d1c7d397-caba-4e64-9a35-a68c403135d4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:43.244766 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d1c7d397-caba-4e64-9a35-a68c403135d4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:43.245175 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d1c7d397-caba-4e64-9a35-a68c403135d4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:43.311597 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-d1c7d397-caba-4e64-9a35-a68c403135d4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:43.319685 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-d1c7d397-caba-4e64-9a35-a68c403135d4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.088626 Aug 24 07:55:43.320258 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 595/1183] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:43 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:44.342913 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-7d6e5a2a-5ee7-43b5-bf71-851dd85b4721 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:44.344056 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-7d6e5a2a-5ee7-43b5-bf71-851dd85b4721 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:44.351153 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7d6e5a2a-5ee7-43b5-bf71-851dd85b4721 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:44.352359 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7d6e5a2a-5ee7-43b5-bf71-851dd85b4721 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:44.352855 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7d6e5a2a-5ee7-43b5-bf71-851dd85b4721 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:44.353669 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7d6e5a2a-5ee7-43b5-bf71-851dd85b4721 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:44.354356 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7d6e5a2a-5ee7-43b5-bf71-851dd85b4721 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:44.354802 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7d6e5a2a-5ee7-43b5-bf71-851dd85b4721 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:44.420168 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-7d6e5a2a-5ee7-43b5-bf71-851dd85b4721 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:44.430583 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-7d6e5a2a-5ee7-43b5-bf71-851dd85b4721 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.091311 Aug 24 07:55:44.431395 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 589/1184] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:44 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:45.451868 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-f98ec37f-7832-48ec-aae0-f097861e4dbf tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:45.452689 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-f98ec37f-7832-48ec-aae0-f097861e4dbf tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:45.459277 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f98ec37f-7832-48ec-aae0-f097861e4dbf tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:45.459750 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f98ec37f-7832-48ec-aae0-f097861e4dbf tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:45.460185 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f98ec37f-7832-48ec-aae0-f097861e4dbf tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:45.460920 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f98ec37f-7832-48ec-aae0-f097861e4dbf tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:45.461365 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f98ec37f-7832-48ec-aae0-f097861e4dbf tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:45.461971 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f98ec37f-7832-48ec-aae0-f097861e4dbf tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:45.530875 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-f98ec37f-7832-48ec-aae0-f097861e4dbf tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:45.540658 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-f98ec37f-7832-48ec-aae0-f097861e4dbf tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.092614 Aug 24 07:55:45.541616 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 596/1185] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:45 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:46.562277 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-e79d025a-2717-4739-ac30-1bb34f0d7d78 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:46.563002 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-e79d025a-2717-4739-ac30-1bb34f0d7d78 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:46.569513 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e79d025a-2717-4739-ac30-1bb34f0d7d78 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:46.569992 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e79d025a-2717-4739-ac30-1bb34f0d7d78 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:46.571238 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e79d025a-2717-4739-ac30-1bb34f0d7d78 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:46.572058 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e79d025a-2717-4739-ac30-1bb34f0d7d78 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:46.572525 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e79d025a-2717-4739-ac30-1bb34f0d7d78 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:46.572952 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e79d025a-2717-4739-ac30-1bb34f0d7d78 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:46.640784 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-e79d025a-2717-4739-ac30-1bb34f0d7d78 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:46.650455 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-e79d025a-2717-4739-ac30-1bb34f0d7d78 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.091909 Aug 24 07:55:46.651069 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 590/1186] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:46 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:47.679006 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-9e893ebf-96d6-421b-8e5c-3ad8f8428d4e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:47.679721 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-9e893ebf-96d6-421b-8e5c-3ad8f8428d4e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:47.688622 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9e893ebf-96d6-421b-8e5c-3ad8f8428d4e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:47.689377 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9e893ebf-96d6-421b-8e5c-3ad8f8428d4e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:47.689984 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9e893ebf-96d6-421b-8e5c-3ad8f8428d4e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:47.691260 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9e893ebf-96d6-421b-8e5c-3ad8f8428d4e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:47.691881 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9e893ebf-96d6-421b-8e5c-3ad8f8428d4e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:47.692434 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9e893ebf-96d6-421b-8e5c-3ad8f8428d4e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:47.770673 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-9e893ebf-96d6-421b-8e5c-3ad8f8428d4e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:47.779217 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-9e893ebf-96d6-421b-8e5c-3ad8f8428d4e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.106432 Aug 24 07:55:47.779785 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 597/1187] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:47 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:48.809149 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-b09fbc07-71b5-4b01-b636-31f70dec47a9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:48.810215 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-b09fbc07-71b5-4b01-b636-31f70dec47a9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:48.812278 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_api:SELECT=28 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:48.817211 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b09fbc07-71b5-4b01-b636-31f70dec47a9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:48.817693 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b09fbc07-71b5-4b01-b636-31f70dec47a9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:48.818121 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b09fbc07-71b5-4b01-b636-31f70dec47a9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:48.818849 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b09fbc07-71b5-4b01-b636-31f70dec47a9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:48.819296 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b09fbc07-71b5-4b01-b636-31f70dec47a9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:48.819710 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b09fbc07-71b5-4b01-b636-31f70dec47a9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:48.823941 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell1:SELECT=84 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:48.898402 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-b09fbc07-71b5-4b01-b636-31f70dec47a9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:48.911069 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-b09fbc07-71b5-4b01-b636-31f70dec47a9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.109422 Aug 24 07:55:48.912071 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 591/1188] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:48 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:49.942869 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-b2d9676b-5ca4-44d4-bc6d-faea1ca300cb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:49.943887 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-b2d9676b-5ca4-44d4-bc6d-faea1ca300cb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:49.947861 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_api:SELECT=28 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:49.955355 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b2d9676b-5ca4-44d4-bc6d-faea1ca300cb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:49.956098 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b2d9676b-5ca4-44d4-bc6d-faea1ca300cb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:49.956633 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b2d9676b-5ca4-44d4-bc6d-faea1ca300cb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:49.957505 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b2d9676b-5ca4-44d4-bc6d-faea1ca300cb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:49.958191 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b2d9676b-5ca4-44d4-bc6d-faea1ca300cb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:49.958849 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b2d9676b-5ca4-44d4-bc6d-faea1ca300cb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:49.966261 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell1:SELECT=84 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:55:50.045945 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-b2d9676b-5ca4-44d4-bc6d-faea1ca300cb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:50.061375 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-b2d9676b-5ca4-44d4-bc6d-faea1ca300cb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.125135 Aug 24 07:55:50.062305 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 598/1189] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:49 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:51.085163 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-c1d7d03e-d1de-4f82-802b-f3101b5cab4e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:51.086341 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-c1d7d03e-d1de-4f82-802b-f3101b5cab4e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:51.093654 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c1d7d03e-d1de-4f82-802b-f3101b5cab4e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:51.094134 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c1d7d03e-d1de-4f82-802b-f3101b5cab4e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:51.094565 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c1d7d03e-d1de-4f82-802b-f3101b5cab4e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:51.095288 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c1d7d03e-d1de-4f82-802b-f3101b5cab4e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:51.095924 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c1d7d03e-d1de-4f82-802b-f3101b5cab4e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:51.096203 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c1d7d03e-d1de-4f82-802b-f3101b5cab4e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:51.165517 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-c1d7d03e-d1de-4f82-802b-f3101b5cab4e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:51.173674 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-c1d7d03e-d1de-4f82-802b-f3101b5cab4e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.092297 Aug 24 07:55:51.174244 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 592/1190] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:51 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:52.202231 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-7e9ecc99-757e-41f8-8459-4edef5dfc7ed tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:52.202976 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-7e9ecc99-757e-41f8-8459-4edef5dfc7ed tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:52.212701 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7e9ecc99-757e-41f8-8459-4edef5dfc7ed tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:52.213183 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7e9ecc99-757e-41f8-8459-4edef5dfc7ed tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:52.213617 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7e9ecc99-757e-41f8-8459-4edef5dfc7ed tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:52.214309 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7e9ecc99-757e-41f8-8459-4edef5dfc7ed tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:52.214794 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7e9ecc99-757e-41f8-8459-4edef5dfc7ed tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:52.215223 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7e9ecc99-757e-41f8-8459-4edef5dfc7ed tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:52.292550 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-7e9ecc99-757e-41f8-8459-4edef5dfc7ed tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:52.300799 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-7e9ecc99-757e-41f8-8459-4edef5dfc7ed tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.102357 Aug 24 07:55:52.301366 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 599/1191] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:52 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:53.323263 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-7e55ea9f-4705-4ed0-82b5-36cc4056fbb7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:53.323825 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-7e55ea9f-4705-4ed0-82b5-36cc4056fbb7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:53.330586 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7e55ea9f-4705-4ed0-82b5-36cc4056fbb7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:53.331135 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7e55ea9f-4705-4ed0-82b5-36cc4056fbb7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:53.331561 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7e55ea9f-4705-4ed0-82b5-36cc4056fbb7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:53.332310 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7e55ea9f-4705-4ed0-82b5-36cc4056fbb7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:53.332755 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7e55ea9f-4705-4ed0-82b5-36cc4056fbb7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:53.333178 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7e55ea9f-4705-4ed0-82b5-36cc4056fbb7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:53.400052 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-7e55ea9f-4705-4ed0-82b5-36cc4056fbb7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:53.412680 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-7e55ea9f-4705-4ed0-82b5-36cc4056fbb7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.093652 Aug 24 07:55:53.413614 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 593/1192] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:53 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:55:54.438861 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-f148120b-39e9-4c06-98ee-015ccd3f4798 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:54.439982 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-f148120b-39e9-4c06-98ee-015ccd3f4798 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:54.451510 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f148120b-39e9-4c06-98ee-015ccd3f4798 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:54.452393 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f148120b-39e9-4c06-98ee-015ccd3f4798 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:54.453283 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f148120b-39e9-4c06-98ee-015ccd3f4798 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:54.454571 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f148120b-39e9-4c06-98ee-015ccd3f4798 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:54.455451 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f148120b-39e9-4c06-98ee-015ccd3f4798 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:54.456275 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-f148120b-39e9-4c06-98ee-015ccd3f4798 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:54.537237 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-f148120b-39e9-4c06-98ee-015ccd3f4798 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:54.546460 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-f148120b-39e9-4c06-98ee-015ccd3f4798 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.114332 Aug 24 07:55:54.547082 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 600/1193] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:54 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:55.571671 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-08a59bb4-ad09-4e28-90eb-1eaa2049796a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:55.572592 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-08a59bb4-ad09-4e28-90eb-1eaa2049796a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:55.584210 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-08a59bb4-ad09-4e28-90eb-1eaa2049796a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:55.585062 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-08a59bb4-ad09-4e28-90eb-1eaa2049796a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:55.586335 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-08a59bb4-ad09-4e28-90eb-1eaa2049796a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:55.587585 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-08a59bb4-ad09-4e28-90eb-1eaa2049796a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:55.588504 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-08a59bb4-ad09-4e28-90eb-1eaa2049796a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:55.589646 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-08a59bb4-ad09-4e28-90eb-1eaa2049796a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:55.675377 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-08a59bb4-ad09-4e28-90eb-1eaa2049796a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:55.685294 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-08a59bb4-ad09-4e28-90eb-1eaa2049796a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.120010 Aug 24 07:55:55.685655 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 594/1194] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:55 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:56.718859 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-5d0d02d3-2168-475e-95d7-013e98b2ac25 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:56.719958 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-5d0d02d3-2168-475e-95d7-013e98b2ac25 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:56.731358 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5d0d02d3-2168-475e-95d7-013e98b2ac25 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:56.732127 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5d0d02d3-2168-475e-95d7-013e98b2ac25 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:56.732931 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5d0d02d3-2168-475e-95d7-013e98b2ac25 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:56.734129 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5d0d02d3-2168-475e-95d7-013e98b2ac25 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:56.735008 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5d0d02d3-2168-475e-95d7-013e98b2ac25 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:56.735769 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5d0d02d3-2168-475e-95d7-013e98b2ac25 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:56.826979 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-5d0d02d3-2168-475e-95d7-013e98b2ac25 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:56.841836 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-5d0d02d3-2168-475e-95d7-013e98b2ac25 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.130160 Aug 24 07:55:56.842768 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 601/1195] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:56 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:55:57.882924 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-1a05ab3e-a531-45e6-a55f-63ec3817108e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:57.884018 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-1a05ab3e-a531-45e6-a55f-63ec3817108e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:57.894870 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1a05ab3e-a531-45e6-a55f-63ec3817108e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:57.895716 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1a05ab3e-a531-45e6-a55f-63ec3817108e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:57.896472 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1a05ab3e-a531-45e6-a55f-63ec3817108e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:57.897686 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1a05ab3e-a531-45e6-a55f-63ec3817108e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:57.898481 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1a05ab3e-a531-45e6-a55f-63ec3817108e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:57.899260 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1a05ab3e-a531-45e6-a55f-63ec3817108e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:57.984264 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-1a05ab3e-a531-45e6-a55f-63ec3817108e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:57.997441 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-1a05ab3e-a531-45e6-a55f-63ec3817108e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.126605 Aug 24 07:55:57.998418 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 595/1196] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:57 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:55:59.024177 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-69a5843f-6071-4b4e-a8bf-ce5b2801ee6a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:55:59.025733 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-69a5843f-6071-4b4e-a8bf-ce5b2801ee6a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:55:59.033816 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-69a5843f-6071-4b4e-a8bf-ce5b2801ee6a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:59.034302 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-69a5843f-6071-4b4e-a8bf-ce5b2801ee6a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:59.034764 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-69a5843f-6071-4b4e-a8bf-ce5b2801ee6a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:59.035474 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-69a5843f-6071-4b4e-a8bf-ce5b2801ee6a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:55:59.035926 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-69a5843f-6071-4b4e-a8bf-ce5b2801ee6a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:55:59.036346 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-69a5843f-6071-4b4e-a8bf-ce5b2801ee6a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:55:59.105758 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-69a5843f-6071-4b4e-a8bf-ce5b2801ee6a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:55:59.114219 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-69a5843f-6071-4b4e-a8bf-ce5b2801ee6a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.094673 Aug 24 07:55:59.114946 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 602/1197] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:55:59 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:00.141521 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-a2398b56-c470-4a9b-ba81-cce7d3adb560 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:00.142581 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-a2398b56-c470-4a9b-ba81-cce7d3adb560 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:00.151476 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a2398b56-c470-4a9b-ba81-cce7d3adb560 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:00.151984 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a2398b56-c470-4a9b-ba81-cce7d3adb560 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:00.152554 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a2398b56-c470-4a9b-ba81-cce7d3adb560 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:00.153549 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a2398b56-c470-4a9b-ba81-cce7d3adb560 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:00.154302 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a2398b56-c470-4a9b-ba81-cce7d3adb560 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:00.154886 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a2398b56-c470-4a9b-ba81-cce7d3adb560 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:00.248269 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-a2398b56-c470-4a9b-ba81-cce7d3adb560 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:00.258180 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-a2398b56-c470-4a9b-ba81-cce7d3adb560 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.123476 Aug 24 07:56:00.258768 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 596/1198] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:00 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:01.283302 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-cd3e3bac-43db-436b-ae29-f7927df6ec36 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:01.284284 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-cd3e3bac-43db-436b-ae29-f7927df6ec36 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:01.295527 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cd3e3bac-43db-436b-ae29-f7927df6ec36 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:01.296453 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cd3e3bac-43db-436b-ae29-f7927df6ec36 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:01.297021 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cd3e3bac-43db-436b-ae29-f7927df6ec36 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:01.297746 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cd3e3bac-43db-436b-ae29-f7927df6ec36 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:01.298214 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cd3e3bac-43db-436b-ae29-f7927df6ec36 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:01.298732 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cd3e3bac-43db-436b-ae29-f7927df6ec36 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:01.393330 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-cd3e3bac-43db-436b-ae29-f7927df6ec36 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:01.406507 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-cd3e3bac-43db-436b-ae29-f7927df6ec36 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.130031 Aug 24 07:56:01.407473 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 603/1199] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:01 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:02.438677 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-fb2c0fb0-9da8-4b4b-bbda-3b819ba0eb06 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:02.439767 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-fb2c0fb0-9da8-4b4b-bbda-3b819ba0eb06 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:02.451607 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-fb2c0fb0-9da8-4b4b-bbda-3b819ba0eb06 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:02.452454 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-fb2c0fb0-9da8-4b4b-bbda-3b819ba0eb06 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:02.453214 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-fb2c0fb0-9da8-4b4b-bbda-3b819ba0eb06 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:02.454421 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-fb2c0fb0-9da8-4b4b-bbda-3b819ba0eb06 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:02.455260 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-fb2c0fb0-9da8-4b4b-bbda-3b819ba0eb06 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:02.456006 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-fb2c0fb0-9da8-4b4b-bbda-3b819ba0eb06 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:02.535959 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-fb2c0fb0-9da8-4b4b-bbda-3b819ba0eb06 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:02.544548 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-fb2c0fb0-9da8-4b4b-bbda-3b819ba0eb06 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.112613 Aug 24 07:56:02.545119 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 597/1200] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:02 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:03.567553 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-9558c55e-5a98-4fca-9c05-1a3553615a0c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:03.568371 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-9558c55e-5a98-4fca-9c05-1a3553615a0c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:03.579689 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9558c55e-5a98-4fca-9c05-1a3553615a0c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:03.580569 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9558c55e-5a98-4fca-9c05-1a3553615a0c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:03.581349 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9558c55e-5a98-4fca-9c05-1a3553615a0c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:03.582590 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9558c55e-5a98-4fca-9c05-1a3553615a0c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:03.583454 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9558c55e-5a98-4fca-9c05-1a3553615a0c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:03.584225 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9558c55e-5a98-4fca-9c05-1a3553615a0c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:03.670476 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-9558c55e-5a98-4fca-9c05-1a3553615a0c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:03.684389 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-9558c55e-5a98-4fca-9c05-1a3553615a0c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.121195 Aug 24 07:56:03.685294 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 604/1201] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:03 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:04.706227 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-191416c5-2a01-4899-b886-8c5ec2dc3037 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:04.707124 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-191416c5-2a01-4899-b886-8c5ec2dc3037 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:04.714269 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-191416c5-2a01-4899-b886-8c5ec2dc3037 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:04.714992 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-191416c5-2a01-4899-b886-8c5ec2dc3037 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:04.715478 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-191416c5-2a01-4899-b886-8c5ec2dc3037 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:04.716249 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-191416c5-2a01-4899-b886-8c5ec2dc3037 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:04.716742 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-191416c5-2a01-4899-b886-8c5ec2dc3037 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:04.717236 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-191416c5-2a01-4899-b886-8c5ec2dc3037 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:04.798525 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-191416c5-2a01-4899-b886-8c5ec2dc3037 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:04.811924 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-191416c5-2a01-4899-b886-8c5ec2dc3037 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.109734 Aug 24 07:56:04.812743 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 598/1202] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:04 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:05.841221 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-6dfd5f5f-a380-4925-911e-53cdfe09e47a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:05.842006 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-6dfd5f5f-a380-4925-911e-53cdfe09e47a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:05.848922 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6dfd5f5f-a380-4925-911e-53cdfe09e47a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:05.849456 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6dfd5f5f-a380-4925-911e-53cdfe09e47a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:05.849939 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6dfd5f5f-a380-4925-911e-53cdfe09e47a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:05.850736 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6dfd5f5f-a380-4925-911e-53cdfe09e47a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:05.851317 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6dfd5f5f-a380-4925-911e-53cdfe09e47a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:05.852409 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6dfd5f5f-a380-4925-911e-53cdfe09e47a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:05.936731 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-6dfd5f5f-a380-4925-911e-53cdfe09e47a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:05.946049 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-6dfd5f5f-a380-4925-911e-53cdfe09e47a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.108724 Aug 24 07:56:05.946632 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 605/1203] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:05 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:56:06.972600 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-19e19547-1a20-4597-bfd3-47f509856d7c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:06.973625 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-19e19547-1a20-4597-bfd3-47f509856d7c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:06.983650 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-19e19547-1a20-4597-bfd3-47f509856d7c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:06.984302 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-19e19547-1a20-4597-bfd3-47f509856d7c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:06.985039 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-19e19547-1a20-4597-bfd3-47f509856d7c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:06.986243 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-19e19547-1a20-4597-bfd3-47f509856d7c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:06.987167 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-19e19547-1a20-4597-bfd3-47f509856d7c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:06.987914 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-19e19547-1a20-4597-bfd3-47f509856d7c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:07.069232 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-19e19547-1a20-4597-bfd3-47f509856d7c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:07.077944 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-19e19547-1a20-4597-bfd3-47f509856d7c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.112543 Aug 24 07:56:07.078528 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 599/1204] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:06 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:08.099577 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-0d4b397e-a0dc-4d82-a6e6-d120d5aea50c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:08.100610 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-0d4b397e-a0dc-4d82-a6e6-d120d5aea50c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:08.108418 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0d4b397e-a0dc-4d82-a6e6-d120d5aea50c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:08.108895 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0d4b397e-a0dc-4d82-a6e6-d120d5aea50c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:08.109323 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0d4b397e-a0dc-4d82-a6e6-d120d5aea50c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:08.110015 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0d4b397e-a0dc-4d82-a6e6-d120d5aea50c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:08.110457 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0d4b397e-a0dc-4d82-a6e6-d120d5aea50c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:08.110908 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0d4b397e-a0dc-4d82-a6e6-d120d5aea50c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:08.213589 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-0d4b397e-a0dc-4d82-a6e6-d120d5aea50c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:08.228342 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-0d4b397e-a0dc-4d82-a6e6-d120d5aea50c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.132451 Aug 24 07:56:08.229362 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 606/1205] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:08 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:09.262009 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-7ed777b3-9d83-493a-8bb7-7cc93ceea2b0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:09.263406 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-7ed777b3-9d83-493a-8bb7-7cc93ceea2b0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:09.271974 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7ed777b3-9d83-493a-8bb7-7cc93ceea2b0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:09.271974 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7ed777b3-9d83-493a-8bb7-7cc93ceea2b0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:09.271974 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7ed777b3-9d83-493a-8bb7-7cc93ceea2b0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:09.275166 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7ed777b3-9d83-493a-8bb7-7cc93ceea2b0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:09.275166 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7ed777b3-9d83-493a-8bb7-7cc93ceea2b0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:09.275166 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7ed777b3-9d83-493a-8bb7-7cc93ceea2b0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:09.339443 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-7ed777b3-9d83-493a-8bb7-7cc93ceea2b0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:09.347866 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-7ed777b3-9d83-493a-8bb7-7cc93ceea2b0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.093372 Aug 24 07:56:09.348517 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 600/1206] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:09 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:56:10.371510 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-1f9d6de5-38d4-4c20-b71b-018a01fdb9c5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:10.372574 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-1f9d6de5-38d4-4c20-b71b-018a01fdb9c5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:10.379693 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1f9d6de5-38d4-4c20-b71b-018a01fdb9c5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:10.380187 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1f9d6de5-38d4-4c20-b71b-018a01fdb9c5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:10.380622 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1f9d6de5-38d4-4c20-b71b-018a01fdb9c5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:10.381326 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1f9d6de5-38d4-4c20-b71b-018a01fdb9c5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:10.381774 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1f9d6de5-38d4-4c20-b71b-018a01fdb9c5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:10.382195 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1f9d6de5-38d4-4c20-b71b-018a01fdb9c5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:10.455911 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-1f9d6de5-38d4-4c20-b71b-018a01fdb9c5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:10.465884 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-1f9d6de5-38d4-4c20-b71b-018a01fdb9c5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.099527 Aug 24 07:56:10.466480 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 607/1207] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:10 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:11.487474 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-a17c759c-761f-453f-b95b-4e2ae0d65657 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:11.488110 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-a17c759c-761f-453f-b95b-4e2ae0d65657 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:11.494682 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a17c759c-761f-453f-b95b-4e2ae0d65657 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:11.495186 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a17c759c-761f-453f-b95b-4e2ae0d65657 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:11.495610 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a17c759c-761f-453f-b95b-4e2ae0d65657 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:11.496299 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a17c759c-761f-453f-b95b-4e2ae0d65657 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:11.496738 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a17c759c-761f-453f-b95b-4e2ae0d65657 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:11.497151 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a17c759c-761f-453f-b95b-4e2ae0d65657 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:11.565306 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-a17c759c-761f-453f-b95b-4e2ae0d65657 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:11.574868 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-a17c759c-761f-453f-b95b-4e2ae0d65657 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.091354 Aug 24 07:56:11.575719 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 601/1208] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:11 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:12.597039 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-275c8c66-8b04-4657-89ad-5844381ceeb4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:12.597708 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-275c8c66-8b04-4657-89ad-5844381ceeb4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:12.608745 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-275c8c66-8b04-4657-89ad-5844381ceeb4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:12.609234 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-275c8c66-8b04-4657-89ad-5844381ceeb4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:12.609730 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-275c8c66-8b04-4657-89ad-5844381ceeb4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:12.610426 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-275c8c66-8b04-4657-89ad-5844381ceeb4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:12.610901 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-275c8c66-8b04-4657-89ad-5844381ceeb4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:12.611322 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-275c8c66-8b04-4657-89ad-5844381ceeb4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:12.674536 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-275c8c66-8b04-4657-89ad-5844381ceeb4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:12.683040 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-275c8c66-8b04-4657-89ad-5844381ceeb4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.089755 Aug 24 07:56:12.683618 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 608/1209] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:12 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:13.705740 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-0a18b593-8168-4dfa-a0b6-b7929a53d424 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:13.706505 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-0a18b593-8168-4dfa-a0b6-b7929a53d424 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:13.712787 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0a18b593-8168-4dfa-a0b6-b7929a53d424 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:13.713271 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0a18b593-8168-4dfa-a0b6-b7929a53d424 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:13.713705 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0a18b593-8168-4dfa-a0b6-b7929a53d424 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:13.714400 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0a18b593-8168-4dfa-a0b6-b7929a53d424 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:13.714898 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0a18b593-8168-4dfa-a0b6-b7929a53d424 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:13.715324 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0a18b593-8168-4dfa-a0b6-b7929a53d424 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:13.786212 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-0a18b593-8168-4dfa-a0b6-b7929a53d424 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:13.799727 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-0a18b593-8168-4dfa-a0b6-b7929a53d424 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.098748 Aug 24 07:56:13.800610 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 602/1210] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:13 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:14.826483 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-1e79af52-7fd1-475e-a717-7e26f3d501fd tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:14.827296 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-1e79af52-7fd1-475e-a717-7e26f3d501fd tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:14.837794 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1e79af52-7fd1-475e-a717-7e26f3d501fd tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:14.838644 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1e79af52-7fd1-475e-a717-7e26f3d501fd tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:14.839447 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1e79af52-7fd1-475e-a717-7e26f3d501fd tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:14.840698 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1e79af52-7fd1-475e-a717-7e26f3d501fd tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:14.841482 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1e79af52-7fd1-475e-a717-7e26f3d501fd tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:14.842187 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1e79af52-7fd1-475e-a717-7e26f3d501fd tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:14.924587 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-1e79af52-7fd1-475e-a717-7e26f3d501fd tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:14.933399 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-1e79af52-7fd1-475e-a717-7e26f3d501fd tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.110964 Aug 24 07:56:14.933961 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 609/1211] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:14 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:15.955075 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-a9ee758b-370d-44d0-8fe5-417946a99ccf tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:15.955774 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-a9ee758b-370d-44d0-8fe5-417946a99ccf tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:15.962919 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a9ee758b-370d-44d0-8fe5-417946a99ccf tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:15.963484 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a9ee758b-370d-44d0-8fe5-417946a99ccf tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:15.963942 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a9ee758b-370d-44d0-8fe5-417946a99ccf tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:15.964653 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a9ee758b-370d-44d0-8fe5-417946a99ccf tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:15.965102 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a9ee758b-370d-44d0-8fe5-417946a99ccf tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:15.965521 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a9ee758b-370d-44d0-8fe5-417946a99ccf tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:16.032350 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-a9ee758b-370d-44d0-8fe5-417946a99ccf tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:16.046088 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-a9ee758b-370d-44d0-8fe5-417946a99ccf tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.094477 Aug 24 07:56:16.047091 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 603/1212] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:15 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:17.080544 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-022ef6f8-6665-4d7e-8736-5ef554851d58 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:17.081136 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-022ef6f8-6665-4d7e-8736-5ef554851d58 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:17.088562 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-022ef6f8-6665-4d7e-8736-5ef554851d58 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:17.089052 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-022ef6f8-6665-4d7e-8736-5ef554851d58 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:17.089489 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-022ef6f8-6665-4d7e-8736-5ef554851d58 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:17.090196 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-022ef6f8-6665-4d7e-8736-5ef554851d58 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:17.090647 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-022ef6f8-6665-4d7e-8736-5ef554851d58 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:17.091112 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-022ef6f8-6665-4d7e-8736-5ef554851d58 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:17.168792 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-022ef6f8-6665-4d7e-8736-5ef554851d58 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:17.176672 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-022ef6f8-6665-4d7e-8736-5ef554851d58 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.100004 Aug 24 07:56:17.177222 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 610/1213] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:17 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:56:18.203635 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-e81f124e-8f81-4301-8f96-9e9b2372275e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:18.204669 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-e81f124e-8f81-4301-8f96-9e9b2372275e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:18.211980 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e81f124e-8f81-4301-8f96-9e9b2372275e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:18.212429 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e81f124e-8f81-4301-8f96-9e9b2372275e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:18.212848 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e81f124e-8f81-4301-8f96-9e9b2372275e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:18.213533 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e81f124e-8f81-4301-8f96-9e9b2372275e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:18.213971 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e81f124e-8f81-4301-8f96-9e9b2372275e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:18.214389 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-e81f124e-8f81-4301-8f96-9e9b2372275e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:18.289057 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-e81f124e-8f81-4301-8f96-9e9b2372275e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:18.301242 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-e81f124e-8f81-4301-8f96-9e9b2372275e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.103981 Aug 24 07:56:18.301829 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 604/1214] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:18 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:19.323062 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-8f68dba7-bf6d-4349-808f-c2e5d6be4eb7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:19.324090 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-8f68dba7-bf6d-4349-808f-c2e5d6be4eb7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:19.331146 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8f68dba7-bf6d-4349-808f-c2e5d6be4eb7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:19.331746 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8f68dba7-bf6d-4349-808f-c2e5d6be4eb7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:19.332368 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8f68dba7-bf6d-4349-808f-c2e5d6be4eb7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:19.333155 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8f68dba7-bf6d-4349-808f-c2e5d6be4eb7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:19.333695 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8f68dba7-bf6d-4349-808f-c2e5d6be4eb7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:19.334376 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-8f68dba7-bf6d-4349-808f-c2e5d6be4eb7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:19.419779 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-8f68dba7-bf6d-4349-808f-c2e5d6be4eb7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:19.434329 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-8f68dba7-bf6d-4349-808f-c2e5d6be4eb7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.115818 Aug 24 07:56:19.434982 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 611/1215] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:19 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:20.465993 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-b30acd17-c47a-44a6-a2f4-42da19335180 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:20.466647 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-b30acd17-c47a-44a6-a2f4-42da19335180 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:20.469215 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_api:SELECT=28 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:20.474405 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b30acd17-c47a-44a6-a2f4-42da19335180 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:20.474918 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b30acd17-c47a-44a6-a2f4-42da19335180 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:20.475342 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b30acd17-c47a-44a6-a2f4-42da19335180 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:20.476038 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b30acd17-c47a-44a6-a2f4-42da19335180 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:20.476484 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b30acd17-c47a-44a6-a2f4-42da19335180 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:20.476918 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b30acd17-c47a-44a6-a2f4-42da19335180 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:20.479928 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell1:SELECT=84 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:20.544715 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-b30acd17-c47a-44a6-a2f4-42da19335180 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:20.552891 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-b30acd17-c47a-44a6-a2f4-42da19335180 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.090698 Aug 24 07:56:20.553477 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 605/1216] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:20 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:21.578837 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-6fbe80e9-ea89-4d38-998d-dfb8dff413a3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:21.579839 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-6fbe80e9-ea89-4d38-998d-dfb8dff413a3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:21.583912 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_api:SELECT=28 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:21.594274 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6fbe80e9-ea89-4d38-998d-dfb8dff413a3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:21.595174 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6fbe80e9-ea89-4d38-998d-dfb8dff413a3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:21.595948 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6fbe80e9-ea89-4d38-998d-dfb8dff413a3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:21.597247 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6fbe80e9-ea89-4d38-998d-dfb8dff413a3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:21.598069 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6fbe80e9-ea89-4d38-998d-dfb8dff413a3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:21.598860 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6fbe80e9-ea89-4d38-998d-dfb8dff413a3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:21.607120 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell1:SELECT=84 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:21.691163 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-6fbe80e9-ea89-4d38-998d-dfb8dff413a3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:21.703996 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-6fbe80e9-ea89-4d38-998d-dfb8dff413a3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.130937 Aug 24 07:56:21.705036 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 612/1217] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:21 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:22.727498 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-321876e1-064f-437e-93eb-103174af793f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:22.728311 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-321876e1-064f-437e-93eb-103174af793f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:22.734495 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-321876e1-064f-437e-93eb-103174af793f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:22.735082 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-321876e1-064f-437e-93eb-103174af793f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:22.735512 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-321876e1-064f-437e-93eb-103174af793f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:22.736214 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-321876e1-064f-437e-93eb-103174af793f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:22.736665 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-321876e1-064f-437e-93eb-103174af793f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:22.737084 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-321876e1-064f-437e-93eb-103174af793f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:22.803626 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-321876e1-064f-437e-93eb-103174af793f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:22.811983 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-321876e1-064f-437e-93eb-103174af793f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.089825 Aug 24 07:56:22.812554 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 606/1218] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:22 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:23.836515 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-892777ab-3566-443d-aa0b-fbefa7d3a087 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:23.837489 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-892777ab-3566-443d-aa0b-fbefa7d3a087 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:23.847539 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-892777ab-3566-443d-aa0b-fbefa7d3a087 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:23.848182 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-892777ab-3566-443d-aa0b-fbefa7d3a087 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:23.848826 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-892777ab-3566-443d-aa0b-fbefa7d3a087 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:23.849925 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-892777ab-3566-443d-aa0b-fbefa7d3a087 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:23.850589 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-892777ab-3566-443d-aa0b-fbefa7d3a087 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:23.851254 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-892777ab-3566-443d-aa0b-fbefa7d3a087 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:23.917402 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-892777ab-3566-443d-aa0b-fbefa7d3a087 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:23.926466 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-892777ab-3566-443d-aa0b-fbefa7d3a087 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.096494 Aug 24 07:56:23.927133 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 613/1219] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:23 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:24.948926 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-38afc036-e685-4a0e-9318-3b2a1dbfee2c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:24.949797 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-38afc036-e685-4a0e-9318-3b2a1dbfee2c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:24.956586 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-38afc036-e685-4a0e-9318-3b2a1dbfee2c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:24.957078 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-38afc036-e685-4a0e-9318-3b2a1dbfee2c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:24.957519 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-38afc036-e685-4a0e-9318-3b2a1dbfee2c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:24.958233 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-38afc036-e685-4a0e-9318-3b2a1dbfee2c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:24.958687 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-38afc036-e685-4a0e-9318-3b2a1dbfee2c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:24.959140 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-38afc036-e685-4a0e-9318-3b2a1dbfee2c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:25.024921 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-38afc036-e685-4a0e-9318-3b2a1dbfee2c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:25.032895 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-38afc036-e685-4a0e-9318-3b2a1dbfee2c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.088705 Aug 24 07:56:25.033788 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 607/1220] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:24 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:26.066237 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-267ce1b4-b596-4d9b-8882-b5707b5075d9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:26.067119 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-267ce1b4-b596-4d9b-8882-b5707b5075d9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:26.077805 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-267ce1b4-b596-4d9b-8882-b5707b5075d9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:26.078297 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-267ce1b4-b596-4d9b-8882-b5707b5075d9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:26.078906 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-267ce1b4-b596-4d9b-8882-b5707b5075d9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:26.079716 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-267ce1b4-b596-4d9b-8882-b5707b5075d9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:26.080404 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-267ce1b4-b596-4d9b-8882-b5707b5075d9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:26.080966 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-267ce1b4-b596-4d9b-8882-b5707b5075d9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:26.160280 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-267ce1b4-b596-4d9b-8882-b5707b5075d9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:26.173699 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-267ce1b4-b596-4d9b-8882-b5707b5075d9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.114188 Aug 24 07:56:26.174469 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 614/1221] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:26 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:56:27.196764 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-324b9e87-2b8a-4a1f-a4d8-8e4841519066 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:27.197774 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-324b9e87-2b8a-4a1f-a4d8-8e4841519066 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:27.204470 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-324b9e87-2b8a-4a1f-a4d8-8e4841519066 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:27.204944 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-324b9e87-2b8a-4a1f-a4d8-8e4841519066 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:27.205380 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-324b9e87-2b8a-4a1f-a4d8-8e4841519066 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:27.206066 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-324b9e87-2b8a-4a1f-a4d8-8e4841519066 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:27.206507 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-324b9e87-2b8a-4a1f-a4d8-8e4841519066 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:27.206953 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-324b9e87-2b8a-4a1f-a4d8-8e4841519066 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:27.269884 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-324b9e87-2b8a-4a1f-a4d8-8e4841519066 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:27.279069 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-324b9e87-2b8a-4a1f-a4d8-8e4841519066 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.086466 Aug 24 07:56:27.279781 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 608/1222] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:27 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:28.300131 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-dca38132-b2c1-48f2-84f6-cc19985d7423 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:28.300801 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-dca38132-b2c1-48f2-84f6-cc19985d7423 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:28.307960 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-dca38132-b2c1-48f2-84f6-cc19985d7423 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:28.308428 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-dca38132-b2c1-48f2-84f6-cc19985d7423 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:28.308865 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-dca38132-b2c1-48f2-84f6-cc19985d7423 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:28.309572 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-dca38132-b2c1-48f2-84f6-cc19985d7423 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:28.310026 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-dca38132-b2c1-48f2-84f6-cc19985d7423 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:28.310450 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-dca38132-b2c1-48f2-84f6-cc19985d7423 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:28.378785 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-dca38132-b2c1-48f2-84f6-cc19985d7423 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:28.386866 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-dca38132-b2c1-48f2-84f6-cc19985d7423 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.090719 Aug 24 07:56:28.387442 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 615/1223] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:28 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:56:29.296157 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 07:56:29.296533 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Wed Aug 24 07:56:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 07:56:29.408629 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-793faafd-ba78-4d6c-a4ba-bad081ff6c81 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:29.409312 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-793faafd-ba78-4d6c-a4ba-bad081ff6c81 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:29.416511 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-793faafd-ba78-4d6c-a4ba-bad081ff6c81 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:29.416985 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-793faafd-ba78-4d6c-a4ba-bad081ff6c81 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:29.417421 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-793faafd-ba78-4d6c-a4ba-bad081ff6c81 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:29.418115 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-793faafd-ba78-4d6c-a4ba-bad081ff6c81 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:29.418567 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-793faafd-ba78-4d6c-a4ba-bad081ff6c81 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:29.419126 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-793faafd-ba78-4d6c-a4ba-bad081ff6c81 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:29.487576 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-793faafd-ba78-4d6c-a4ba-bad081ff6c81 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:29.497362 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-793faafd-ba78-4d6c-a4ba-bad081ff6c81 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.092700 Aug 24 07:56:29.497969 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 609/1224] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:29 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:30.519383 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-a36436f7-dc78-45af-9ed2-6a94556871a3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:30.520208 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-a36436f7-dc78-45af-9ed2-6a94556871a3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:30.527283 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a36436f7-dc78-45af-9ed2-6a94556871a3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:30.527756 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a36436f7-dc78-45af-9ed2-6a94556871a3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:30.528189 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a36436f7-dc78-45af-9ed2-6a94556871a3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:30.528888 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a36436f7-dc78-45af-9ed2-6a94556871a3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:30.529324 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a36436f7-dc78-45af-9ed2-6a94556871a3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:30.529741 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a36436f7-dc78-45af-9ed2-6a94556871a3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:30.596922 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-a36436f7-dc78-45af-9ed2-6a94556871a3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:30.605998 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-a36436f7-dc78-45af-9ed2-6a94556871a3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.090523 Aug 24 07:56:30.606569 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 616/1225] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:30 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:31.627267 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-b624f055-0bc6-45b2-893c-70cdf83d6fbb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:31.627865 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-b624f055-0bc6-45b2-893c-70cdf83d6fbb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:31.635393 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b624f055-0bc6-45b2-893c-70cdf83d6fbb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:31.635879 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b624f055-0bc6-45b2-893c-70cdf83d6fbb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:31.636311 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b624f055-0bc6-45b2-893c-70cdf83d6fbb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:31.637014 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b624f055-0bc6-45b2-893c-70cdf83d6fbb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:31.637463 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b624f055-0bc6-45b2-893c-70cdf83d6fbb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:31.637883 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b624f055-0bc6-45b2-893c-70cdf83d6fbb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:31.702937 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-b624f055-0bc6-45b2-893c-70cdf83d6fbb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:31.710519 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-b624f055-0bc6-45b2-893c-70cdf83d6fbb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.087158 Aug 24 07:56:31.711122 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 610/1226] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:31 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:32.731185 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-646dc958-4137-450f-82d5-6b67f7dd6750 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:32.731795 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-646dc958-4137-450f-82d5-6b67f7dd6750 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:32.738815 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-646dc958-4137-450f-82d5-6b67f7dd6750 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:32.739671 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-646dc958-4137-450f-82d5-6b67f7dd6750 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:32.739823 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-646dc958-4137-450f-82d5-6b67f7dd6750 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:32.740468 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-646dc958-4137-450f-82d5-6b67f7dd6750 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:32.740923 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-646dc958-4137-450f-82d5-6b67f7dd6750 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:32.741372 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-646dc958-4137-450f-82d5-6b67f7dd6750 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:32.805342 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-646dc958-4137-450f-82d5-6b67f7dd6750 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:32.815642 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-646dc958-4137-450f-82d5-6b67f7dd6750 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.088283 Aug 24 07:56:32.816218 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 617/1227] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:32 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:33.837641 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-ba8b9b7b-3158-4690-b3fd-910b4664e022 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:33.838212 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-ba8b9b7b-3158-4690-b3fd-910b4664e022 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:33.845637 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ba8b9b7b-3158-4690-b3fd-910b4664e022 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:33.846178 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ba8b9b7b-3158-4690-b3fd-910b4664e022 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:33.846612 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ba8b9b7b-3158-4690-b3fd-910b4664e022 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:33.847352 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ba8b9b7b-3158-4690-b3fd-910b4664e022 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:33.847796 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ba8b9b7b-3158-4690-b3fd-910b4664e022 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:33.848225 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ba8b9b7b-3158-4690-b3fd-910b4664e022 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:33.919799 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-ba8b9b7b-3158-4690-b3fd-910b4664e022 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:33.928555 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-ba8b9b7b-3158-4690-b3fd-910b4664e022 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.095484 Aug 24 07:56:33.929370 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 611/1228] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:33 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:34.949739 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-46b88ab9-0908-445f-ba19-519ca0b4890e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:34.950427 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-46b88ab9-0908-445f-ba19-519ca0b4890e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:34.958226 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-46b88ab9-0908-445f-ba19-519ca0b4890e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:34.958735 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-46b88ab9-0908-445f-ba19-519ca0b4890e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:34.959160 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-46b88ab9-0908-445f-ba19-519ca0b4890e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:34.959867 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-46b88ab9-0908-445f-ba19-519ca0b4890e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:34.960325 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-46b88ab9-0908-445f-ba19-519ca0b4890e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:34.960747 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-46b88ab9-0908-445f-ba19-519ca0b4890e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:35.027024 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-46b88ab9-0908-445f-ba19-519ca0b4890e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:35.040444 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-46b88ab9-0908-445f-ba19-519ca0b4890e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.094500 Aug 24 07:56:35.041024 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 618/1229] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:34 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:36.062724 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-cbf098b5-346f-4fd5-85d1-ca467df96dbb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:36.063534 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-cbf098b5-346f-4fd5-85d1-ca467df96dbb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:36.070347 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-cbf098b5-346f-4fd5-85d1-ca467df96dbb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:36.071455 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-cbf098b5-346f-4fd5-85d1-ca467df96dbb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:36.071888 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-cbf098b5-346f-4fd5-85d1-ca467df96dbb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:36.072581 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-cbf098b5-346f-4fd5-85d1-ca467df96dbb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:36.073036 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-cbf098b5-346f-4fd5-85d1-ca467df96dbb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:36.073453 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-cbf098b5-346f-4fd5-85d1-ca467df96dbb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:36.141708 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-cbf098b5-346f-4fd5-85d1-ca467df96dbb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:36.153763 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-cbf098b5-346f-4fd5-85d1-ca467df96dbb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.094781 Aug 24 07:56:36.154828 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 612/1230] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:36 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:37.176423 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-1bf41d7f-690e-4072-a922-5a117c887539 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:37.177032 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-1bf41d7f-690e-4072-a922-5a117c887539 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:37.184235 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1bf41d7f-690e-4072-a922-5a117c887539 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:37.184712 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1bf41d7f-690e-4072-a922-5a117c887539 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:37.185145 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1bf41d7f-690e-4072-a922-5a117c887539 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:37.185852 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1bf41d7f-690e-4072-a922-5a117c887539 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:37.186307 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1bf41d7f-690e-4072-a922-5a117c887539 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:37.186742 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-1bf41d7f-690e-4072-a922-5a117c887539 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:37.259450 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-1bf41d7f-690e-4072-a922-5a117c887539 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:37.267585 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-1bf41d7f-690e-4072-a922-5a117c887539 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.095380 Aug 24 07:56:37.268158 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 619/1231] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:37 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:38.297581 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-f934bf93-3181-4ea5-8b63-6034131243c0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:38.298192 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-f934bf93-3181-4ea5-8b63-6034131243c0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:38.307893 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f934bf93-3181-4ea5-8b63-6034131243c0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:38.308354 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f934bf93-3181-4ea5-8b63-6034131243c0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:38.308790 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f934bf93-3181-4ea5-8b63-6034131243c0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:38.309486 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f934bf93-3181-4ea5-8b63-6034131243c0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:38.309958 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f934bf93-3181-4ea5-8b63-6034131243c0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:38.310394 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f934bf93-3181-4ea5-8b63-6034131243c0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:38.375429 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-f934bf93-3181-4ea5-8b63-6034131243c0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:38.386855 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-f934bf93-3181-4ea5-8b63-6034131243c0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.092994 Aug 24 07:56:38.387583 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 613/1232] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:38 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:39.410878 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-3441b90d-dc5a-47d2-b125-bbc7ba1dc465 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:39.411610 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-3441b90d-dc5a-47d2-b125-bbc7ba1dc465 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:39.419955 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3441b90d-dc5a-47d2-b125-bbc7ba1dc465 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:39.420506 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3441b90d-dc5a-47d2-b125-bbc7ba1dc465 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:39.420914 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3441b90d-dc5a-47d2-b125-bbc7ba1dc465 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:39.421617 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3441b90d-dc5a-47d2-b125-bbc7ba1dc465 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:39.422062 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3441b90d-dc5a-47d2-b125-bbc7ba1dc465 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:39.422480 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3441b90d-dc5a-47d2-b125-bbc7ba1dc465 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:39.497005 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-3441b90d-dc5a-47d2-b125-bbc7ba1dc465 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:39.504791 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-3441b90d-dc5a-47d2-b125-bbc7ba1dc465 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.099901 Aug 24 07:56:39.505363 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 620/1233] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:39 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:40.525426 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-ca577285-55ef-464c-aedd-cdab1349c83e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:40.526060 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-ca577285-55ef-464c-aedd-cdab1349c83e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:40.532949 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ca577285-55ef-464c-aedd-cdab1349c83e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:40.533428 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ca577285-55ef-464c-aedd-cdab1349c83e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:40.533859 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ca577285-55ef-464c-aedd-cdab1349c83e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:40.534556 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ca577285-55ef-464c-aedd-cdab1349c83e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:40.535031 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ca577285-55ef-464c-aedd-cdab1349c83e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:40.535448 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ca577285-55ef-464c-aedd-cdab1349c83e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:40.606145 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-ca577285-55ef-464c-aedd-cdab1349c83e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:40.614495 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-ca577285-55ef-464c-aedd-cdab1349c83e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.092839 Aug 24 07:56:40.615109 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 614/1234] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:40 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:41.636482 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-432b6e52-d331-4a3d-b3f9-ff454beb56c2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:41.637261 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-432b6e52-d331-4a3d-b3f9-ff454beb56c2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:41.644047 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-432b6e52-d331-4a3d-b3f9-ff454beb56c2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:41.644526 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-432b6e52-d331-4a3d-b3f9-ff454beb56c2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:41.644954 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-432b6e52-d331-4a3d-b3f9-ff454beb56c2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:41.645672 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-432b6e52-d331-4a3d-b3f9-ff454beb56c2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:41.646124 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-432b6e52-d331-4a3d-b3f9-ff454beb56c2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:41.646534 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-432b6e52-d331-4a3d-b3f9-ff454beb56c2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:41.718959 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-432b6e52-d331-4a3d-b3f9-ff454beb56c2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:41.728548 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-432b6e52-d331-4a3d-b3f9-ff454beb56c2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.096017 Aug 24 07:56:41.729121 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 621/1235] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:41 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:42.749787 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-6ea85f9c-ec3b-46a7-889e-05d5806c4526 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:42.750383 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-6ea85f9c-ec3b-46a7-889e-05d5806c4526 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:42.757002 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6ea85f9c-ec3b-46a7-889e-05d5806c4526 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:42.757488 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6ea85f9c-ec3b-46a7-889e-05d5806c4526 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:42.757923 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6ea85f9c-ec3b-46a7-889e-05d5806c4526 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:42.759212 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6ea85f9c-ec3b-46a7-889e-05d5806c4526 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:42.759671 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6ea85f9c-ec3b-46a7-889e-05d5806c4526 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:42.760093 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6ea85f9c-ec3b-46a7-889e-05d5806c4526 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:42.823298 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-6ea85f9c-ec3b-46a7-889e-05d5806c4526 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:42.832866 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-6ea85f9c-ec3b-46a7-889e-05d5806c4526 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.086849 Aug 24 07:56:42.833440 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 615/1236] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:42 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:43.856447 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-79f7bd6c-1bd5-4334-98d8-3aad09a69d69 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:43.857125 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-79f7bd6c-1bd5-4334-98d8-3aad09a69d69 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:43.864070 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-79f7bd6c-1bd5-4334-98d8-3aad09a69d69 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:43.864583 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-79f7bd6c-1bd5-4334-98d8-3aad09a69d69 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:43.865023 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-79f7bd6c-1bd5-4334-98d8-3aad09a69d69 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:43.865736 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-79f7bd6c-1bd5-4334-98d8-3aad09a69d69 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:43.866194 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-79f7bd6c-1bd5-4334-98d8-3aad09a69d69 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:43.866615 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-79f7bd6c-1bd5-4334-98d8-3aad09a69d69 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:43.945398 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-79f7bd6c-1bd5-4334-98d8-3aad09a69d69 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:43.953899 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-79f7bd6c-1bd5-4334-98d8-3aad09a69d69 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.101753 Aug 24 07:56:43.955173 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 622/1237] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:43 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:44.977390 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-853ff138-0968-4e9b-b5f7-1e45a71892a9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:44.977997 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-853ff138-0968-4e9b-b5f7-1e45a71892a9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:44.984589 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-853ff138-0968-4e9b-b5f7-1e45a71892a9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:44.985066 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-853ff138-0968-4e9b-b5f7-1e45a71892a9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:44.985500 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-853ff138-0968-4e9b-b5f7-1e45a71892a9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:44.986243 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-853ff138-0968-4e9b-b5f7-1e45a71892a9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:44.986687 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-853ff138-0968-4e9b-b5f7-1e45a71892a9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:44.987136 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-853ff138-0968-4e9b-b5f7-1e45a71892a9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:45.059008 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-853ff138-0968-4e9b-b5f7-1e45a71892a9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:45.070292 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-853ff138-0968-4e9b-b5f7-1e45a71892a9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.098270 Aug 24 07:56:45.071531 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 616/1238] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:44 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:46.092470 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-6ad67900-dc4b-4529-b9e8-00587b2bf46d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:46.093089 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-6ad67900-dc4b-4529-b9e8-00587b2bf46d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:46.100305 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6ad67900-dc4b-4529-b9e8-00587b2bf46d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:46.100785 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6ad67900-dc4b-4529-b9e8-00587b2bf46d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:46.101217 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6ad67900-dc4b-4529-b9e8-00587b2bf46d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:46.102481 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6ad67900-dc4b-4529-b9e8-00587b2bf46d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:46.102961 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6ad67900-dc4b-4529-b9e8-00587b2bf46d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:46.103381 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6ad67900-dc4b-4529-b9e8-00587b2bf46d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:46.172807 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-6ad67900-dc4b-4529-b9e8-00587b2bf46d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:46.181470 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-6ad67900-dc4b-4529-b9e8-00587b2bf46d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.092895 Aug 24 07:56:46.182186 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 623/1239] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:46 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:56:47.204649 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-c8d40741-aee0-42fc-b7a8-be92852defa4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:47.205277 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-c8d40741-aee0-42fc-b7a8-be92852defa4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:47.212013 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c8d40741-aee0-42fc-b7a8-be92852defa4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:47.212480 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c8d40741-aee0-42fc-b7a8-be92852defa4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:47.212914 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c8d40741-aee0-42fc-b7a8-be92852defa4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:47.213597 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c8d40741-aee0-42fc-b7a8-be92852defa4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:47.214035 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c8d40741-aee0-42fc-b7a8-be92852defa4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:47.214456 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c8d40741-aee0-42fc-b7a8-be92852defa4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:47.280795 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-c8d40741-aee0-42fc-b7a8-be92852defa4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:47.288743 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-c8d40741-aee0-42fc-b7a8-be92852defa4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.088554 Aug 24 07:56:47.289337 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 617/1240] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:47 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:48.309416 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-e2405304-afd1-4230-be18-4a38692b5d05 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:48.312080 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-e2405304-afd1-4230-be18-4a38692b5d05 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:48.326196 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e2405304-afd1-4230-be18-4a38692b5d05 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:48.326675 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e2405304-afd1-4230-be18-4a38692b5d05 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:48.327142 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e2405304-afd1-4230-be18-4a38692b5d05 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:48.327834 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e2405304-afd1-4230-be18-4a38692b5d05 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:48.328283 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e2405304-afd1-4230-be18-4a38692b5d05 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:48.328776 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e2405304-afd1-4230-be18-4a38692b5d05 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:48.677199 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-e2405304-afd1-4230-be18-4a38692b5d05 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:48.686657 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-e2405304-afd1-4230-be18-4a38692b5d05 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.381191 Aug 24 07:56:48.687293 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 624/1241] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:48 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:49.708153 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-b34d0648-9902-4e4b-9fe2-b0b046f36f25 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:49.708865 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-b34d0648-9902-4e4b-9fe2-b0b046f36f25 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:49.716381 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b34d0648-9902-4e4b-9fe2-b0b046f36f25 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:49.716869 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b34d0648-9902-4e4b-9fe2-b0b046f36f25 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:49.717306 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b34d0648-9902-4e4b-9fe2-b0b046f36f25 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:49.718005 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b34d0648-9902-4e4b-9fe2-b0b046f36f25 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:49.718450 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b34d0648-9902-4e4b-9fe2-b0b046f36f25 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:49.718917 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b34d0648-9902-4e4b-9fe2-b0b046f36f25 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:49.786108 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-b34d0648-9902-4e4b-9fe2-b0b046f36f25 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:49.795214 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-b34d0648-9902-4e4b-9fe2-b0b046f36f25 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.090944 Aug 24 07:56:49.795804 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 618/1242] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:49 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:50.816724 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-428f8289-a8d6-4f19-8e46-2541b21d4550 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:50.817328 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-428f8289-a8d6-4f19-8e46-2541b21d4550 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:50.824395 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-428f8289-a8d6-4f19-8e46-2541b21d4550 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:50.824867 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-428f8289-a8d6-4f19-8e46-2541b21d4550 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:50.825378 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-428f8289-a8d6-4f19-8e46-2541b21d4550 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:50.825981 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-428f8289-a8d6-4f19-8e46-2541b21d4550 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:50.826424 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-428f8289-a8d6-4f19-8e46-2541b21d4550 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:50.826870 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-428f8289-a8d6-4f19-8e46-2541b21d4550 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:50.888271 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-428f8289-a8d6-4f19-8e46-2541b21d4550 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:50.895948 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-428f8289-a8d6-4f19-8e46-2541b21d4550 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.083137 Aug 24 07:56:50.896508 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 625/1243] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:50 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:51.916795 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-07c6b9ed-2496-4eee-9334-0cd8b0c330f7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:51.917412 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-07c6b9ed-2496-4eee-9334-0cd8b0c330f7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:51.919754 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_api:SELECT=28 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:51.925563 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-07c6b9ed-2496-4eee-9334-0cd8b0c330f7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:51.926078 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-07c6b9ed-2496-4eee-9334-0cd8b0c330f7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:51.926515 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-07c6b9ed-2496-4eee-9334-0cd8b0c330f7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:51.931908 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-07c6b9ed-2496-4eee-9334-0cd8b0c330f7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:51.931908 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-07c6b9ed-2496-4eee-9334-0cd8b0c330f7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:51.931908 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-07c6b9ed-2496-4eee-9334-0cd8b0c330f7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:51.931908 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell1:SELECT=84 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:51.991897 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-07c6b9ed-2496-4eee-9334-0cd8b0c330f7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:51.999821 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-07c6b9ed-2496-4eee-9334-0cd8b0c330f7 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.087396 Aug 24 07:56:52.000389 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 619/1244] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:51 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:53.020896 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-62ad1c0c-6f3b-4e24-8a26-1e5973ff8aba tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:53.021501 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-62ad1c0c-6f3b-4e24-8a26-1e5973ff8aba tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:53.023852 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_api:SELECT=28 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:53.029470 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-62ad1c0c-6f3b-4e24-8a26-1e5973ff8aba tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:53.030044 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-62ad1c0c-6f3b-4e24-8a26-1e5973ff8aba tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:53.030500 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-62ad1c0c-6f3b-4e24-8a26-1e5973ff8aba tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:53.031243 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-62ad1c0c-6f3b-4e24-8a26-1e5973ff8aba tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:53.031698 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-62ad1c0c-6f3b-4e24-8a26-1e5973ff8aba tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:53.032118 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-62ad1c0c-6f3b-4e24-8a26-1e5973ff8aba tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:53.034840 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell1:SELECT=84 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:56:53.093874 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-62ad1c0c-6f3b-4e24-8a26-1e5973ff8aba tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:53.101778 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-62ad1c0c-6f3b-4e24-8a26-1e5973ff8aba tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.084775 Aug 24 07:56:53.102326 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 626/1245] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:53 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:54.123591 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-f506abd7-8e21-4011-b195-b83296124e5d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:54.124195 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-f506abd7-8e21-4011-b195-b83296124e5d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:54.130608 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f506abd7-8e21-4011-b195-b83296124e5d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:54.131126 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f506abd7-8e21-4011-b195-b83296124e5d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:54.131552 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f506abd7-8e21-4011-b195-b83296124e5d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:54.132241 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f506abd7-8e21-4011-b195-b83296124e5d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:54.132686 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f506abd7-8e21-4011-b195-b83296124e5d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:54.133100 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f506abd7-8e21-4011-b195-b83296124e5d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:54.195147 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-f506abd7-8e21-4011-b195-b83296124e5d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:54.203533 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-f506abd7-8e21-4011-b195-b83296124e5d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.083765 Aug 24 07:56:54.204080 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 620/1246] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:54 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:55.224221 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-9158f797-617d-42c8-b5d0-5a5e411b220b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:55.224828 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-9158f797-617d-42c8-b5d0-5a5e411b220b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:55.234343 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9158f797-617d-42c8-b5d0-5a5e411b220b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:55.234848 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9158f797-617d-42c8-b5d0-5a5e411b220b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:55.235278 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9158f797-617d-42c8-b5d0-5a5e411b220b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:55.235994 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9158f797-617d-42c8-b5d0-5a5e411b220b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:55.236437 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9158f797-617d-42c8-b5d0-5a5e411b220b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:55.236852 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9158f797-617d-42c8-b5d0-5a5e411b220b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:55.297838 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-9158f797-617d-42c8-b5d0-5a5e411b220b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:55.306403 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-9158f797-617d-42c8-b5d0-5a5e411b220b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.085455 Aug 24 07:56:55.307001 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 627/1247] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:55 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:56.327121 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-40b7085e-fdd1-41cf-8af1-411b51376381 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:56.327773 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-40b7085e-fdd1-41cf-8af1-411b51376381 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:56.334450 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-40b7085e-fdd1-41cf-8af1-411b51376381 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:56.334962 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-40b7085e-fdd1-41cf-8af1-411b51376381 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:56.335394 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-40b7085e-fdd1-41cf-8af1-411b51376381 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:56.336086 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-40b7085e-fdd1-41cf-8af1-411b51376381 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:56.336533 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-40b7085e-fdd1-41cf-8af1-411b51376381 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:56.337017 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-40b7085e-fdd1-41cf-8af1-411b51376381 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:56.399359 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-40b7085e-fdd1-41cf-8af1-411b51376381 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:56.407836 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-40b7085e-fdd1-41cf-8af1-411b51376381 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.084679 Aug 24 07:56:56.408403 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 621/1248] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:56 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:57.429458 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-6a8d44c1-e900-46ae-9fa9-f8bb7ce98dd8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:57.430324 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-6a8d44c1-e900-46ae-9fa9-f8bb7ce98dd8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:57.437058 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6a8d44c1-e900-46ae-9fa9-f8bb7ce98dd8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:57.437540 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6a8d44c1-e900-46ae-9fa9-f8bb7ce98dd8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:57.437976 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6a8d44c1-e900-46ae-9fa9-f8bb7ce98dd8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:57.438673 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6a8d44c1-e900-46ae-9fa9-f8bb7ce98dd8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:57.439150 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6a8d44c1-e900-46ae-9fa9-f8bb7ce98dd8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:57.439573 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6a8d44c1-e900-46ae-9fa9-f8bb7ce98dd8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:57.503037 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-6a8d44c1-e900-46ae-9fa9-f8bb7ce98dd8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:57.511102 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-6a8d44c1-e900-46ae-9fa9-f8bb7ce98dd8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.085659 Aug 24 07:56:57.511661 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 628/1249] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:57 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:58.532150 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-51b8f0c3-2337-4262-8c18-611b5858446b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:58.532769 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-51b8f0c3-2337-4262-8c18-611b5858446b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:58.539425 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-51b8f0c3-2337-4262-8c18-611b5858446b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:58.539874 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-51b8f0c3-2337-4262-8c18-611b5858446b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:58.540302 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-51b8f0c3-2337-4262-8c18-611b5858446b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:58.540988 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-51b8f0c3-2337-4262-8c18-611b5858446b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:58.541433 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-51b8f0c3-2337-4262-8c18-611b5858446b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:58.541849 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-51b8f0c3-2337-4262-8c18-611b5858446b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:58.609123 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-51b8f0c3-2337-4262-8c18-611b5858446b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:58.616949 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-51b8f0c3-2337-4262-8c18-611b5858446b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.088719 Aug 24 07:56:58.617516 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 622/1250] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:58 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:56:59.639176 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-dd7f821a-5e51-4203-91b3-d67694ea47d3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:56:59.639764 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-dd7f821a-5e51-4203-91b3-d67694ea47d3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:56:59.646622 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-dd7f821a-5e51-4203-91b3-d67694ea47d3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:59.647143 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-dd7f821a-5e51-4203-91b3-d67694ea47d3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:59.647580 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-dd7f821a-5e51-4203-91b3-d67694ea47d3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:59.648286 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-dd7f821a-5e51-4203-91b3-d67694ea47d3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:56:59.648739 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-dd7f821a-5e51-4203-91b3-d67694ea47d3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:56:59.649159 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-dd7f821a-5e51-4203-91b3-d67694ea47d3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:56:59.711787 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-dd7f821a-5e51-4203-91b3-d67694ea47d3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:56:59.719938 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-dd7f821a-5e51-4203-91b3-d67694ea47d3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.084721 Aug 24 07:56:59.720809 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 629/1251] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:56:59 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:00.743553 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-31bbac51-d493-4ccf-9015-1f6828d7c8b3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:00.744160 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-31bbac51-d493-4ccf-9015-1f6828d7c8b3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:00.750480 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-31bbac51-d493-4ccf-9015-1f6828d7c8b3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:00.750995 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-31bbac51-d493-4ccf-9015-1f6828d7c8b3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:00.751429 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-31bbac51-d493-4ccf-9015-1f6828d7c8b3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:00.752124 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-31bbac51-d493-4ccf-9015-1f6828d7c8b3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:00.752572 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-31bbac51-d493-4ccf-9015-1f6828d7c8b3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:00.752992 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-31bbac51-d493-4ccf-9015-1f6828d7c8b3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:00.813871 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-31bbac51-d493-4ccf-9015-1f6828d7c8b3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:00.821523 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-31bbac51-d493-4ccf-9015-1f6828d7c8b3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.081840 Aug 24 07:57:00.822087 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 623/1252] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:00 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:01.841522 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-fd97baca-3227-4058-aaac-255c070a48a1 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:01.842103 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-fd97baca-3227-4058-aaac-255c070a48a1 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:01.848535 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fd97baca-3227-4058-aaac-255c070a48a1 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:01.849064 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fd97baca-3227-4058-aaac-255c070a48a1 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:01.849494 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fd97baca-3227-4058-aaac-255c070a48a1 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:01.850177 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fd97baca-3227-4058-aaac-255c070a48a1 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:01.850622 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fd97baca-3227-4058-aaac-255c070a48a1 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:01.851083 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-fd97baca-3227-4058-aaac-255c070a48a1 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:01.913644 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-fd97baca-3227-4058-aaac-255c070a48a1 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:01.922192 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-fd97baca-3227-4058-aaac-255c070a48a1 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.084602 Aug 24 07:57:01.922780 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 630/1253] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:01 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:02.943766 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-be04994c-11f7-427b-93e0-4e186592ac87 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:02.944398 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-be04994c-11f7-427b-93e0-4e186592ac87 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:02.951007 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-be04994c-11f7-427b-93e0-4e186592ac87 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:02.951480 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-be04994c-11f7-427b-93e0-4e186592ac87 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:02.951907 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-be04994c-11f7-427b-93e0-4e186592ac87 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:02.952589 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-be04994c-11f7-427b-93e0-4e186592ac87 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:02.953032 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-be04994c-11f7-427b-93e0-4e186592ac87 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:02.953443 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-be04994c-11f7-427b-93e0-4e186592ac87 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:03.013977 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-be04994c-11f7-427b-93e0-4e186592ac87 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:03.021660 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-be04994c-11f7-427b-93e0-4e186592ac87 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.081840 Aug 24 07:57:03.022210 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 624/1254] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:02 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:04.043313 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-0bf0cfef-deb0-486a-939d-f5a2f204d401 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:04.043861 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-0bf0cfef-deb0-486a-939d-f5a2f204d401 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:04.050307 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0bf0cfef-deb0-486a-939d-f5a2f204d401 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:04.050818 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0bf0cfef-deb0-486a-939d-f5a2f204d401 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:04.051253 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0bf0cfef-deb0-486a-939d-f5a2f204d401 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:04.051943 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0bf0cfef-deb0-486a-939d-f5a2f204d401 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:04.052389 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0bf0cfef-deb0-486a-939d-f5a2f204d401 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:04.052811 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-0bf0cfef-deb0-486a-939d-f5a2f204d401 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:04.112355 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-0bf0cfef-deb0-486a-939d-f5a2f204d401 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:04.120062 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-0bf0cfef-deb0-486a-939d-f5a2f204d401 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.081299 Aug 24 07:57:04.120622 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 631/1255] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:04 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:05.139728 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-cc1c22fd-a8a2-4a21-b4e3-dd10d3952c9a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:05.140318 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-cc1c22fd-a8a2-4a21-b4e3-dd10d3952c9a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:05.146879 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-cc1c22fd-a8a2-4a21-b4e3-dd10d3952c9a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:05.147416 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-cc1c22fd-a8a2-4a21-b4e3-dd10d3952c9a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:05.147931 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-cc1c22fd-a8a2-4a21-b4e3-dd10d3952c9a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:05.148609 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-cc1c22fd-a8a2-4a21-b4e3-dd10d3952c9a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:05.149052 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-cc1c22fd-a8a2-4a21-b4e3-dd10d3952c9a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:05.149464 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-cc1c22fd-a8a2-4a21-b4e3-dd10d3952c9a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:05.211872 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-cc1c22fd-a8a2-4a21-b4e3-dd10d3952c9a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:05.220170 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-cc1c22fd-a8a2-4a21-b4e3-dd10d3952c9a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.084372 Aug 24 07:57:05.220720 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 625/1256] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:05 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:06.241615 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-4c451428-7e44-416f-a14a-876f76e98c4d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:06.242246 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-4c451428-7e44-416f-a14a-876f76e98c4d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:06.250338 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4c451428-7e44-416f-a14a-876f76e98c4d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:06.250858 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4c451428-7e44-416f-a14a-876f76e98c4d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:06.251293 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4c451428-7e44-416f-a14a-876f76e98c4d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:06.251989 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4c451428-7e44-416f-a14a-876f76e98c4d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:06.252437 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4c451428-7e44-416f-a14a-876f76e98c4d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:06.252856 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4c451428-7e44-416f-a14a-876f76e98c4d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:06.320439 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-4c451428-7e44-416f-a14a-876f76e98c4d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:06.328596 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-4c451428-7e44-416f-a14a-876f76e98c4d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.091029 Aug 24 07:57:06.329149 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 632/1257] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:06 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:07.350042 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-ca465021-9a01-476a-b873-f4b112a7a446 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:07.350734 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-ca465021-9a01-476a-b873-f4b112a7a446 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:07.360852 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ca465021-9a01-476a-b873-f4b112a7a446 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:07.361567 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ca465021-9a01-476a-b873-f4b112a7a446 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:07.362035 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ca465021-9a01-476a-b873-f4b112a7a446 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:07.363059 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ca465021-9a01-476a-b873-f4b112a7a446 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:07.363842 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ca465021-9a01-476a-b873-f4b112a7a446 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:07.364394 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ca465021-9a01-476a-b873-f4b112a7a446 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:07.441700 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-ca465021-9a01-476a-b873-f4b112a7a446 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:07.450140 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-ca465021-9a01-476a-b873-f4b112a7a446 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.103983 Aug 24 07:57:07.450731 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 626/1258] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:07 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:08.472353 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-21308a81-2355-4617-8c8b-e598d50372fa tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:08.472963 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-21308a81-2355-4617-8c8b-e598d50372fa tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:08.479922 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-21308a81-2355-4617-8c8b-e598d50372fa tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:08.480541 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-21308a81-2355-4617-8c8b-e598d50372fa tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:08.481068 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-21308a81-2355-4617-8c8b-e598d50372fa tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:08.481877 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-21308a81-2355-4617-8c8b-e598d50372fa tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:08.482471 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-21308a81-2355-4617-8c8b-e598d50372fa tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:08.483020 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-21308a81-2355-4617-8c8b-e598d50372fa tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:08.559696 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-21308a81-2355-4617-8c8b-e598d50372fa tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:08.569464 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-21308a81-2355-4617-8c8b-e598d50372fa tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.101192 Aug 24 07:57:08.570046 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 633/1259] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:08 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:09.595687 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-7c3278a8-d239-4179-a312-b12c16f676eb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:09.596298 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-7c3278a8-d239-4179-a312-b12c16f676eb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:09.602811 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7c3278a8-d239-4179-a312-b12c16f676eb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:09.603291 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7c3278a8-d239-4179-a312-b12c16f676eb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:09.603726 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7c3278a8-d239-4179-a312-b12c16f676eb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:09.604421 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7c3278a8-d239-4179-a312-b12c16f676eb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:09.604872 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7c3278a8-d239-4179-a312-b12c16f676eb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:09.605304 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7c3278a8-d239-4179-a312-b12c16f676eb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:09.673435 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-7c3278a8-d239-4179-a312-b12c16f676eb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:09.682602 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-7c3278a8-d239-4179-a312-b12c16f676eb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.090739 Aug 24 07:57:09.683193 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 627/1260] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:09 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:10.704428 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-16fea184-2ded-4db7-97e5-3a7c964403b9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:10.705272 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-16fea184-2ded-4db7-97e5-3a7c964403b9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:10.712106 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-16fea184-2ded-4db7-97e5-3a7c964403b9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:10.712586 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-16fea184-2ded-4db7-97e5-3a7c964403b9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:10.713022 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-16fea184-2ded-4db7-97e5-3a7c964403b9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:10.713732 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-16fea184-2ded-4db7-97e5-3a7c964403b9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:10.714161 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-16fea184-2ded-4db7-97e5-3a7c964403b9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:10.714581 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-16fea184-2ded-4db7-97e5-3a7c964403b9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:10.782950 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-16fea184-2ded-4db7-97e5-3a7c964403b9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:10.792540 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-16fea184-2ded-4db7-97e5-3a7c964403b9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.091876 Aug 24 07:57:10.793133 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 634/1261] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:10 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:11.813673 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-a3567bbe-2d1f-4a58-b484-a7cf3fdda1cb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:11.814279 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-a3567bbe-2d1f-4a58-b484-a7cf3fdda1cb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:11.821259 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a3567bbe-2d1f-4a58-b484-a7cf3fdda1cb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:11.821734 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a3567bbe-2d1f-4a58-b484-a7cf3fdda1cb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:11.822173 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a3567bbe-2d1f-4a58-b484-a7cf3fdda1cb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:11.822911 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a3567bbe-2d1f-4a58-b484-a7cf3fdda1cb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:11.823357 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a3567bbe-2d1f-4a58-b484-a7cf3fdda1cb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:11.823775 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-a3567bbe-2d1f-4a58-b484-a7cf3fdda1cb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:11.889041 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-a3567bbe-2d1f-4a58-b484-a7cf3fdda1cb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:11.897072 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-a3567bbe-2d1f-4a58-b484-a7cf3fdda1cb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.087767 Aug 24 07:57:11.897633 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 628/1262] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:11 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:12.917500 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-50426e5a-e039-472d-a38f-6ca07c7c7258 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:12.918214 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-50426e5a-e039-472d-a38f-6ca07c7c7258 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:12.925080 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-50426e5a-e039-472d-a38f-6ca07c7c7258 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:12.925552 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-50426e5a-e039-472d-a38f-6ca07c7c7258 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:12.925979 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-50426e5a-e039-472d-a38f-6ca07c7c7258 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:12.926656 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-50426e5a-e039-472d-a38f-6ca07c7c7258 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:12.927130 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-50426e5a-e039-472d-a38f-6ca07c7c7258 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:12.927543 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-50426e5a-e039-472d-a38f-6ca07c7c7258 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:12.991353 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-50426e5a-e039-472d-a38f-6ca07c7c7258 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:12.999872 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-50426e5a-e039-472d-a38f-6ca07c7c7258 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.086136 Aug 24 07:57:13.000449 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 635/1263] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:12 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:14.021259 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-652bc23b-b1b3-4630-9a7d-53fc5a32774e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:14.021906 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-652bc23b-b1b3-4630-9a7d-53fc5a32774e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:14.028481 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-652bc23b-b1b3-4630-9a7d-53fc5a32774e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:14.028955 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-652bc23b-b1b3-4630-9a7d-53fc5a32774e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:14.029386 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-652bc23b-b1b3-4630-9a7d-53fc5a32774e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:14.030090 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-652bc23b-b1b3-4630-9a7d-53fc5a32774e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:14.030538 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-652bc23b-b1b3-4630-9a7d-53fc5a32774e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:14.030992 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-652bc23b-b1b3-4630-9a7d-53fc5a32774e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:14.100163 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-652bc23b-b1b3-4630-9a7d-53fc5a32774e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:14.108544 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-652bc23b-b1b3-4630-9a7d-53fc5a32774e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.091227 Aug 24 07:57:14.109117 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 629/1264] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:14 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:15.128989 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-3dc2bc33-a4e6-49ba-8268-76a3459e80c2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:15.129656 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-3dc2bc33-a4e6-49ba-8268-76a3459e80c2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:15.136205 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3dc2bc33-a4e6-49ba-8268-76a3459e80c2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:15.136680 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3dc2bc33-a4e6-49ba-8268-76a3459e80c2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:15.137753 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3dc2bc33-a4e6-49ba-8268-76a3459e80c2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:15.138487 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3dc2bc33-a4e6-49ba-8268-76a3459e80c2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:15.138970 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3dc2bc33-a4e6-49ba-8268-76a3459e80c2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:15.139393 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3dc2bc33-a4e6-49ba-8268-76a3459e80c2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:15.206017 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-3dc2bc33-a4e6-49ba-8268-76a3459e80c2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:15.213889 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-3dc2bc33-a4e6-49ba-8268-76a3459e80c2 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.088743 Aug 24 07:57:15.214463 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 636/1265] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:15 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:16.235025 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-ac816bc1-1b69-422b-8ffd-ecd34acfc0fc tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:16.236017 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-ac816bc1-1b69-422b-8ffd-ecd34acfc0fc tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:16.243063 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ac816bc1-1b69-422b-8ffd-ecd34acfc0fc tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:16.243655 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ac816bc1-1b69-422b-8ffd-ecd34acfc0fc tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:16.244199 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ac816bc1-1b69-422b-8ffd-ecd34acfc0fc tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:16.244990 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ac816bc1-1b69-422b-8ffd-ecd34acfc0fc tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:16.245543 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ac816bc1-1b69-422b-8ffd-ecd34acfc0fc tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:16.246059 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ac816bc1-1b69-422b-8ffd-ecd34acfc0fc tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:16.317551 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-ac816bc1-1b69-422b-8ffd-ecd34acfc0fc tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:16.326860 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-ac816bc1-1b69-422b-8ffd-ecd34acfc0fc tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.095854 Aug 24 07:57:16.327644 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 630/1266] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:16 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:17.348664 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-badd4989-f275-401a-84e4-1d53fe7a34b1 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:17.349447 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-badd4989-f275-401a-84e4-1d53fe7a34b1 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:17.355915 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-badd4989-f275-401a-84e4-1d53fe7a34b1 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:17.356366 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-badd4989-f275-401a-84e4-1d53fe7a34b1 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:17.356793 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-badd4989-f275-401a-84e4-1d53fe7a34b1 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:17.357472 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-badd4989-f275-401a-84e4-1d53fe7a34b1 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:17.357916 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-badd4989-f275-401a-84e4-1d53fe7a34b1 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:17.358329 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-badd4989-f275-401a-84e4-1d53fe7a34b1 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:17.421142 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-badd4989-f275-401a-84e4-1d53fe7a34b1 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:17.437312 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-badd4989-f275-401a-84e4-1d53fe7a34b1 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.092726 Aug 24 07:57:17.438066 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 637/1267] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:17 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:18.460927 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-c47edb17-e7fa-48c1-9100-aef300b57f08 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:18.461598 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-c47edb17-e7fa-48c1-9100-aef300b57f08 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:18.469465 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c47edb17-e7fa-48c1-9100-aef300b57f08 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:18.470088 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c47edb17-e7fa-48c1-9100-aef300b57f08 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:18.470726 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c47edb17-e7fa-48c1-9100-aef300b57f08 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:18.471525 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c47edb17-e7fa-48c1-9100-aef300b57f08 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:18.472085 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c47edb17-e7fa-48c1-9100-aef300b57f08 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:18.472682 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c47edb17-e7fa-48c1-9100-aef300b57f08 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:18.536879 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-c47edb17-e7fa-48c1-9100-aef300b57f08 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:18.547325 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-c47edb17-e7fa-48c1-9100-aef300b57f08 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.090663 Aug 24 07:57:18.547906 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 631/1268] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:18 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:19.570099 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-6f73dbfb-0c6d-47bc-ba18-a7969cbdf564 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:19.570674 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-6f73dbfb-0c6d-47bc-ba18-a7969cbdf564 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:19.578073 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6f73dbfb-0c6d-47bc-ba18-a7969cbdf564 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:19.578491 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6f73dbfb-0c6d-47bc-ba18-a7969cbdf564 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:19.579039 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6f73dbfb-0c6d-47bc-ba18-a7969cbdf564 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:19.579994 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6f73dbfb-0c6d-47bc-ba18-a7969cbdf564 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:19.580670 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6f73dbfb-0c6d-47bc-ba18-a7969cbdf564 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:19.581443 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6f73dbfb-0c6d-47bc-ba18-a7969cbdf564 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:19.651084 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-6f73dbfb-0c6d-47bc-ba18-a7969cbdf564 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:19.660220 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-6f73dbfb-0c6d-47bc-ba18-a7969cbdf564 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.094729 Aug 24 07:57:19.660806 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 638/1269] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:19 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:20.682245 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-c945bd55-d7a7-4eef-8352-4f2ef759742f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:20.683355 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-c945bd55-d7a7-4eef-8352-4f2ef759742f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:20.691282 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c945bd55-d7a7-4eef-8352-4f2ef759742f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:20.691898 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c945bd55-d7a7-4eef-8352-4f2ef759742f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:20.692688 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c945bd55-d7a7-4eef-8352-4f2ef759742f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:20.693497 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c945bd55-d7a7-4eef-8352-4f2ef759742f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:20.694075 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c945bd55-d7a7-4eef-8352-4f2ef759742f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:20.694588 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c945bd55-d7a7-4eef-8352-4f2ef759742f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:20.764486 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-c945bd55-d7a7-4eef-8352-4f2ef759742f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:20.776234 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-c945bd55-d7a7-4eef-8352-4f2ef759742f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.097961 Aug 24 07:57:20.776816 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 632/1270] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:20 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:21.804651 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-6c656e28-2fb2-4750-98bc-064b40001c2c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:21.805530 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-6c656e28-2fb2-4750-98bc-064b40001c2c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:21.812611 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6c656e28-2fb2-4750-98bc-064b40001c2c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:21.813175 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6c656e28-2fb2-4750-98bc-064b40001c2c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:21.813591 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6c656e28-2fb2-4750-98bc-064b40001c2c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:21.814231 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6c656e28-2fb2-4750-98bc-064b40001c2c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:21.814684 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6c656e28-2fb2-4750-98bc-064b40001c2c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:21.815135 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-6c656e28-2fb2-4750-98bc-064b40001c2c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:21.876706 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-6c656e28-2fb2-4750-98bc-064b40001c2c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:21.884679 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-6c656e28-2fb2-4750-98bc-064b40001c2c tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.084013 Aug 24 07:57:21.885286 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 639/1271] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:21 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:22.911945 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-0a7d9b67-afaa-4b08-93ff-4c03cca6aff1 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:22.912908 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-0a7d9b67-afaa-4b08-93ff-4c03cca6aff1 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:22.916305 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_api:SELECT=28 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:22.922494 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0a7d9b67-afaa-4b08-93ff-4c03cca6aff1 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:22.923116 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0a7d9b67-afaa-4b08-93ff-4c03cca6aff1 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:22.923576 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0a7d9b67-afaa-4b08-93ff-4c03cca6aff1 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:22.924298 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0a7d9b67-afaa-4b08-93ff-4c03cca6aff1 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:22.924749 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0a7d9b67-afaa-4b08-93ff-4c03cca6aff1 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:22.925175 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0a7d9b67-afaa-4b08-93ff-4c03cca6aff1 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:22.927793 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell1:SELECT=84 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:22.987346 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-0a7d9b67-afaa-4b08-93ff-4c03cca6aff1 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:22.995246 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-0a7d9b67-afaa-4b08-93ff-4c03cca6aff1 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.092653 Aug 24 07:57:22.995809 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 633/1272] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:22 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:24.017701 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-5571ea17-8a69-4893-9437-710a5eaff596 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:24.018404 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-5571ea17-8a69-4893-9437-710a5eaff596 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:24.020640 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_api:SELECT=28 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:24.025907 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5571ea17-8a69-4893-9437-710a5eaff596 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:24.026378 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5571ea17-8a69-4893-9437-710a5eaff596 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:24.026831 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5571ea17-8a69-4893-9437-710a5eaff596 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:24.027512 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5571ea17-8a69-4893-9437-710a5eaff596 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:24.027952 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5571ea17-8a69-4893-9437-710a5eaff596 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:24.028363 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5571ea17-8a69-4893-9437-710a5eaff596 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:24.031072 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell1:SELECT=84 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:24.092931 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-5571ea17-8a69-4893-9437-710a5eaff596 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:24.100569 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-5571ea17-8a69-4893-9437-710a5eaff596 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.086824 Aug 24 07:57:24.101131 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 640/1273] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:24 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:25.121362 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-54f24ab3-058f-4204-8cc6-6c997a8214c6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:25.122515 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-54f24ab3-058f-4204-8cc6-6c997a8214c6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:25.129154 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-54f24ab3-058f-4204-8cc6-6c997a8214c6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:25.129636 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-54f24ab3-058f-4204-8cc6-6c997a8214c6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:25.130092 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-54f24ab3-058f-4204-8cc6-6c997a8214c6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:25.130833 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-54f24ab3-058f-4204-8cc6-6c997a8214c6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:25.131286 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-54f24ab3-058f-4204-8cc6-6c997a8214c6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:25.131703 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-54f24ab3-058f-4204-8cc6-6c997a8214c6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:25.202720 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-54f24ab3-058f-4204-8cc6-6c997a8214c6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:25.210422 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-54f24ab3-058f-4204-8cc6-6c997a8214c6 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.093113 Aug 24 07:57:25.211020 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 634/1274] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:25 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:26.232315 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-4d18e902-3704-43c2-af9e-d46d774a6c57 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:26.232913 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-4d18e902-3704-43c2-af9e-d46d774a6c57 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:26.239418 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4d18e902-3704-43c2-af9e-d46d774a6c57 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:26.239892 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4d18e902-3704-43c2-af9e-d46d774a6c57 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:26.240319 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4d18e902-3704-43c2-af9e-d46d774a6c57 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:26.241004 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4d18e902-3704-43c2-af9e-d46d774a6c57 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:26.241448 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4d18e902-3704-43c2-af9e-d46d774a6c57 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:26.241862 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4d18e902-3704-43c2-af9e-d46d774a6c57 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:26.307183 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-4d18e902-3704-43c2-af9e-d46d774a6c57 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:26.321890 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-4d18e902-3704-43c2-af9e-d46d774a6c57 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.093087 Aug 24 07:57:26.322773 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 641/1275] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:26 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:27.353744 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-914c19f2-5b4d-4fbb-ad01-48efd6ea291a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:27.354367 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-914c19f2-5b4d-4fbb-ad01-48efd6ea291a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:27.361395 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-914c19f2-5b4d-4fbb-ad01-48efd6ea291a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:27.361872 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-914c19f2-5b4d-4fbb-ad01-48efd6ea291a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:27.362307 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-914c19f2-5b4d-4fbb-ad01-48efd6ea291a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:27.363038 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-914c19f2-5b4d-4fbb-ad01-48efd6ea291a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:27.363497 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-914c19f2-5b4d-4fbb-ad01-48efd6ea291a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:27.363923 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-914c19f2-5b4d-4fbb-ad01-48efd6ea291a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:27.433132 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-914c19f2-5b4d-4fbb-ad01-48efd6ea291a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:27.441215 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-914c19f2-5b4d-4fbb-ad01-48efd6ea291a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.091376 Aug 24 07:57:27.441768 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 635/1276] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:27 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:28.462487 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-2aebad40-d575-4971-a18f-19aebd0204da tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:28.463119 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-2aebad40-d575-4971-a18f-19aebd0204da tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:28.470231 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2aebad40-d575-4971-a18f-19aebd0204da tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:28.470885 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2aebad40-d575-4971-a18f-19aebd0204da tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:28.471432 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2aebad40-d575-4971-a18f-19aebd0204da tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:28.472220 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2aebad40-d575-4971-a18f-19aebd0204da tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:28.472766 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2aebad40-d575-4971-a18f-19aebd0204da tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:28.473287 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-2aebad40-d575-4971-a18f-19aebd0204da tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:28.548124 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-2aebad40-d575-4971-a18f-19aebd0204da tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:28.556568 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-2aebad40-d575-4971-a18f-19aebd0204da tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.098378 Aug 24 07:57:28.557147 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 642/1277] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:28 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:29.577866 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-788fce1e-cb6a-4627-85f6-45d5e36214d9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:29.578542 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-788fce1e-cb6a-4627-85f6-45d5e36214d9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:29.585286 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-788fce1e-cb6a-4627-85f6-45d5e36214d9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:29.585805 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-788fce1e-cb6a-4627-85f6-45d5e36214d9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:29.586223 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-788fce1e-cb6a-4627-85f6-45d5e36214d9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:29.586933 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-788fce1e-cb6a-4627-85f6-45d5e36214d9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:29.587412 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-788fce1e-cb6a-4627-85f6-45d5e36214d9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:29.587806 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-788fce1e-cb6a-4627-85f6-45d5e36214d9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:29.665861 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-788fce1e-cb6a-4627-85f6-45d5e36214d9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:29.673759 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-788fce1e-cb6a-4627-85f6-45d5e36214d9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.100266 Aug 24 07:57:29.674321 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 636/1278] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:29 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:30.746097 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-827a7b44-3ff4-40d8-8f77-e522deef9809 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:30.747254 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-827a7b44-3ff4-40d8-8f77-e522deef9809 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:30.753353 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-827a7b44-3ff4-40d8-8f77-e522deef9809 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:30.753830 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-827a7b44-3ff4-40d8-8f77-e522deef9809 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:30.754272 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-827a7b44-3ff4-40d8-8f77-e522deef9809 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:30.755006 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-827a7b44-3ff4-40d8-8f77-e522deef9809 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:30.755472 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-827a7b44-3ff4-40d8-8f77-e522deef9809 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:30.755871 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-827a7b44-3ff4-40d8-8f77-e522deef9809 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:30.820670 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-827a7b44-3ff4-40d8-8f77-e522deef9809 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:30.829093 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-827a7b44-3ff4-40d8-8f77-e522deef9809 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.138577 Aug 24 07:57:30.829656 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 643/1279] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:30 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:31.849386 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-d1e531e1-0121-46cc-af2d-2fdae16cdf3b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:31.849991 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-d1e531e1-0121-46cc-af2d-2fdae16cdf3b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:31.856428 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d1e531e1-0121-46cc-af2d-2fdae16cdf3b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:31.856901 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d1e531e1-0121-46cc-af2d-2fdae16cdf3b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:31.857330 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d1e531e1-0121-46cc-af2d-2fdae16cdf3b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:31.858008 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d1e531e1-0121-46cc-af2d-2fdae16cdf3b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:31.858460 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d1e531e1-0121-46cc-af2d-2fdae16cdf3b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:31.858906 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d1e531e1-0121-46cc-af2d-2fdae16cdf3b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:31.919356 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-d1e531e1-0121-46cc-af2d-2fdae16cdf3b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:31.928553 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-d1e531e1-0121-46cc-af2d-2fdae16cdf3b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.082946 Aug 24 07:57:31.929123 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 637/1280] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:31 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:32.954058 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-3c35e4f3-0647-46fb-a574-5fe6ed1b5b88 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:32.954719 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-3c35e4f3-0647-46fb-a574-5fe6ed1b5b88 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:32.961225 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3c35e4f3-0647-46fb-a574-5fe6ed1b5b88 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:32.961695 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3c35e4f3-0647-46fb-a574-5fe6ed1b5b88 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:32.962260 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3c35e4f3-0647-46fb-a574-5fe6ed1b5b88 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:32.962977 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3c35e4f3-0647-46fb-a574-5fe6ed1b5b88 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:32.963422 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3c35e4f3-0647-46fb-a574-5fe6ed1b5b88 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:32.963836 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3c35e4f3-0647-46fb-a574-5fe6ed1b5b88 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:33.038026 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-3c35e4f3-0647-46fb-a574-5fe6ed1b5b88 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:33.046688 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-3c35e4f3-0647-46fb-a574-5fe6ed1b5b88 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.096415 Aug 24 07:57:33.047275 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 644/1281] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:32 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:34.068798 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-ade4b62b-a177-4d63-990a-6da9ff9ef216 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:34.069497 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-ade4b62b-a177-4d63-990a-6da9ff9ef216 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:34.076689 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ade4b62b-a177-4d63-990a-6da9ff9ef216 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:34.077343 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ade4b62b-a177-4d63-990a-6da9ff9ef216 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:34.077774 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ade4b62b-a177-4d63-990a-6da9ff9ef216 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:34.078511 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ade4b62b-a177-4d63-990a-6da9ff9ef216 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:34.079017 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ade4b62b-a177-4d63-990a-6da9ff9ef216 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:34.079433 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ade4b62b-a177-4d63-990a-6da9ff9ef216 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:34.150855 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-ade4b62b-a177-4d63-990a-6da9ff9ef216 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:34.159359 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-ade4b62b-a177-4d63-990a-6da9ff9ef216 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.094625 Aug 24 07:57:34.159934 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 638/1282] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:34 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:35.181344 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-9b0c56dc-5726-4929-8cd8-a82bf9c9a29d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:35.181949 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-9b0c56dc-5726-4929-8cd8-a82bf9c9a29d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:35.188945 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9b0c56dc-5726-4929-8cd8-a82bf9c9a29d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:35.189428 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9b0c56dc-5726-4929-8cd8-a82bf9c9a29d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:35.189861 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9b0c56dc-5726-4929-8cd8-a82bf9c9a29d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:35.190552 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9b0c56dc-5726-4929-8cd8-a82bf9c9a29d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:35.191043 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9b0c56dc-5726-4929-8cd8-a82bf9c9a29d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:35.191468 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9b0c56dc-5726-4929-8cd8-a82bf9c9a29d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:35.252035 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-9b0c56dc-5726-4929-8cd8-a82bf9c9a29d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:35.259667 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-9b0c56dc-5726-4929-8cd8-a82bf9c9a29d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.082508 Aug 24 07:57:35.260224 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 645/1283] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:35 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:36.281616 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-ad3c880e-86a5-4079-b733-5d84e616cf4f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:36.282263 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-ad3c880e-86a5-4079-b733-5d84e616cf4f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:36.289589 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ad3c880e-86a5-4079-b733-5d84e616cf4f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:36.290054 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ad3c880e-86a5-4079-b733-5d84e616cf4f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:36.290488 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ad3c880e-86a5-4079-b733-5d84e616cf4f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:36.291288 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ad3c880e-86a5-4079-b733-5d84e616cf4f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:36.291768 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ad3c880e-86a5-4079-b733-5d84e616cf4f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:36.292198 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-ad3c880e-86a5-4079-b733-5d84e616cf4f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:36.354666 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-ad3c880e-86a5-4079-b733-5d84e616cf4f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:36.362662 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-ad3c880e-86a5-4079-b733-5d84e616cf4f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.085135 Aug 24 07:57:36.363302 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 639/1284] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:36 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:37.384148 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-4102ff54-d266-45ae-86d9-5c82bb946903 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:37.384862 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-4102ff54-d266-45ae-86d9-5c82bb946903 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:37.391936 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4102ff54-d266-45ae-86d9-5c82bb946903 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:37.392410 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4102ff54-d266-45ae-86d9-5c82bb946903 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:37.392837 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4102ff54-d266-45ae-86d9-5c82bb946903 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:37.393522 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4102ff54-d266-45ae-86d9-5c82bb946903 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:37.393965 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4102ff54-d266-45ae-86d9-5c82bb946903 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:37.394380 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-4102ff54-d266-45ae-86d9-5c82bb946903 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:37.456645 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-4102ff54-d266-45ae-86d9-5c82bb946903 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:37.464363 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-4102ff54-d266-45ae-86d9-5c82bb946903 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.084231 Aug 24 07:57:37.464926 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 646/1285] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:37 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:38.486952 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-461587e3-a269-4a82-a285-18ef41181c93 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:38.487616 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-461587e3-a269-4a82-a285-18ef41181c93 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:38.495499 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-461587e3-a269-4a82-a285-18ef41181c93 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:38.495982 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-461587e3-a269-4a82-a285-18ef41181c93 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:38.496419 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-461587e3-a269-4a82-a285-18ef41181c93 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:38.497155 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-461587e3-a269-4a82-a285-18ef41181c93 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:38.497608 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-461587e3-a269-4a82-a285-18ef41181c93 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:38.498030 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-461587e3-a269-4a82-a285-18ef41181c93 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:38.559752 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-461587e3-a269-4a82-a285-18ef41181c93 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:38.568413 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-461587e3-a269-4a82-a285-18ef41181c93 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.086125 Aug 24 07:57:38.569023 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 640/1286] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:38 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:39.589447 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-ce7068c2-411b-47ad-b93e-916934e335a4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:39.590049 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-ce7068c2-411b-47ad-b93e-916934e335a4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:39.597056 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ce7068c2-411b-47ad-b93e-916934e335a4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:39.597529 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ce7068c2-411b-47ad-b93e-916934e335a4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:39.597956 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ce7068c2-411b-47ad-b93e-916934e335a4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:39.598634 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ce7068c2-411b-47ad-b93e-916934e335a4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:39.599106 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ce7068c2-411b-47ad-b93e-916934e335a4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:39.599521 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-ce7068c2-411b-47ad-b93e-916934e335a4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:39.666642 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-ce7068c2-411b-47ad-b93e-916934e335a4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:39.674780 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-ce7068c2-411b-47ad-b93e-916934e335a4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.089185 Aug 24 07:57:39.675334 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 647/1287] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:39 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:40.698622 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-db1d0c7b-8d38-407a-949d-390eccbb50d8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:40.699286 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-db1d0c7b-8d38-407a-949d-390eccbb50d8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:40.705899 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-db1d0c7b-8d38-407a-949d-390eccbb50d8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:40.706381 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-db1d0c7b-8d38-407a-949d-390eccbb50d8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:40.706839 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-db1d0c7b-8d38-407a-949d-390eccbb50d8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:40.707528 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-db1d0c7b-8d38-407a-949d-390eccbb50d8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:40.707977 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-db1d0c7b-8d38-407a-949d-390eccbb50d8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:40.708399 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-db1d0c7b-8d38-407a-949d-390eccbb50d8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:40.769962 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-db1d0c7b-8d38-407a-949d-390eccbb50d8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:40.778023 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-db1d0c7b-8d38-407a-949d-390eccbb50d8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.086088 Aug 24 07:57:40.778207 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 641/1288] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:40 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:41.800598 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-139d168a-9fde-4f28-8634-551a6eaa476a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:41.801208 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-139d168a-9fde-4f28-8634-551a6eaa476a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:41.807940 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-139d168a-9fde-4f28-8634-551a6eaa476a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:41.808414 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-139d168a-9fde-4f28-8634-551a6eaa476a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:41.808906 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-139d168a-9fde-4f28-8634-551a6eaa476a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:41.809917 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-139d168a-9fde-4f28-8634-551a6eaa476a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:41.810491 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-139d168a-9fde-4f28-8634-551a6eaa476a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:41.811056 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-139d168a-9fde-4f28-8634-551a6eaa476a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:41.876478 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-139d168a-9fde-4f28-8634-551a6eaa476a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:41.884058 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-139d168a-9fde-4f28-8634-551a6eaa476a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.088216 Aug 24 07:57:41.884615 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 648/1289] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:41 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:42.905195 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-6c0bfb18-af71-4abb-90ef-51d9dd70866e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:42.905787 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-6c0bfb18-af71-4abb-90ef-51d9dd70866e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:42.912355 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6c0bfb18-af71-4abb-90ef-51d9dd70866e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:42.912832 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6c0bfb18-af71-4abb-90ef-51d9dd70866e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:42.913261 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6c0bfb18-af71-4abb-90ef-51d9dd70866e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:42.913951 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6c0bfb18-af71-4abb-90ef-51d9dd70866e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:42.914394 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6c0bfb18-af71-4abb-90ef-51d9dd70866e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:42.914851 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-6c0bfb18-af71-4abb-90ef-51d9dd70866e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:42.978266 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-6c0bfb18-af71-4abb-90ef-51d9dd70866e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:42.986547 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-6c0bfb18-af71-4abb-90ef-51d9dd70866e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.085796 Aug 24 07:57:42.987151 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 642/1290] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:42 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:44.008651 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-15c8b5ea-01cd-4952-9251-6f4779f0ed57 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:44.009388 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-15c8b5ea-01cd-4952-9251-6f4779f0ed57 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:44.016254 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-15c8b5ea-01cd-4952-9251-6f4779f0ed57 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:44.016731 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-15c8b5ea-01cd-4952-9251-6f4779f0ed57 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:44.017159 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-15c8b5ea-01cd-4952-9251-6f4779f0ed57 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:44.017850 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-15c8b5ea-01cd-4952-9251-6f4779f0ed57 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:44.018300 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-15c8b5ea-01cd-4952-9251-6f4779f0ed57 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:44.018738 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-15c8b5ea-01cd-4952-9251-6f4779f0ed57 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:44.080268 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-15c8b5ea-01cd-4952-9251-6f4779f0ed57 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:44.088023 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-15c8b5ea-01cd-4952-9251-6f4779f0ed57 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.084464 Aug 24 07:57:44.088582 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 649/1291] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:44 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:45.109296 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-f58e8bb8-c68c-45be-afb4-71e30ff18ead tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:45.109945 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-f58e8bb8-c68c-45be-afb4-71e30ff18ead tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:45.116535 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f58e8bb8-c68c-45be-afb4-71e30ff18ead tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:45.117009 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f58e8bb8-c68c-45be-afb4-71e30ff18ead tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:45.117436 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f58e8bb8-c68c-45be-afb4-71e30ff18ead tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:45.118116 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f58e8bb8-c68c-45be-afb4-71e30ff18ead tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:45.118564 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f58e8bb8-c68c-45be-afb4-71e30ff18ead tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:45.119007 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-f58e8bb8-c68c-45be-afb4-71e30ff18ead tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:45.182664 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-f58e8bb8-c68c-45be-afb4-71e30ff18ead tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:45.191458 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-f58e8bb8-c68c-45be-afb4-71e30ff18ead tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.086017 Aug 24 07:57:45.192041 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 643/1292] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:45 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:46.213245 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-def79d5a-d2fc-41f1-b532-6ce9fe1a9f99 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:46.213810 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-def79d5a-d2fc-41f1-b532-6ce9fe1a9f99 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:46.221100 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-def79d5a-d2fc-41f1-b532-6ce9fe1a9f99 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:46.221583 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-def79d5a-d2fc-41f1-b532-6ce9fe1a9f99 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:46.222024 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-def79d5a-d2fc-41f1-b532-6ce9fe1a9f99 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:46.222747 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-def79d5a-d2fc-41f1-b532-6ce9fe1a9f99 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:46.223206 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-def79d5a-d2fc-41f1-b532-6ce9fe1a9f99 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:46.223631 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-def79d5a-d2fc-41f1-b532-6ce9fe1a9f99 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:46.284583 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-def79d5a-d2fc-41f1-b532-6ce9fe1a9f99 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:46.292226 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-def79d5a-d2fc-41f1-b532-6ce9fe1a9f99 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.082929 Aug 24 07:57:46.292785 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 650/1293] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:46 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:47.313490 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-07de7d0f-7c71-4855-bce6-12c08d29c3db tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:47.314179 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-07de7d0f-7c71-4855-bce6-12c08d29c3db tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:47.320739 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-07de7d0f-7c71-4855-bce6-12c08d29c3db tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:47.321215 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-07de7d0f-7c71-4855-bce6-12c08d29c3db tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:47.321646 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-07de7d0f-7c71-4855-bce6-12c08d29c3db tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:47.322319 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-07de7d0f-7c71-4855-bce6-12c08d29c3db tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:47.322792 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-07de7d0f-7c71-4855-bce6-12c08d29c3db tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:47.323212 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-07de7d0f-7c71-4855-bce6-12c08d29c3db tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:47.385803 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-07de7d0f-7c71-4855-bce6-12c08d29c3db tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:47.395319 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-07de7d0f-7c71-4855-bce6-12c08d29c3db tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.086374 Aug 24 07:57:47.395927 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 644/1294] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:47 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:48.416403 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-352a5ecd-6e35-4954-9903-043894e3c31e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:48.417029 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-352a5ecd-6e35-4954-9903-043894e3c31e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:48.423424 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-352a5ecd-6e35-4954-9903-043894e3c31e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:48.423893 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-352a5ecd-6e35-4954-9903-043894e3c31e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:48.424318 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-352a5ecd-6e35-4954-9903-043894e3c31e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:48.424989 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-352a5ecd-6e35-4954-9903-043894e3c31e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:48.425434 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-352a5ecd-6e35-4954-9903-043894e3c31e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:48.425845 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-352a5ecd-6e35-4954-9903-043894e3c31e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:48.484528 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-352a5ecd-6e35-4954-9903-043894e3c31e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:48.492023 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-352a5ecd-6e35-4954-9903-043894e3c31e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.079544 Aug 24 07:57:48.492774 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 651/1295] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:48 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:57:49.511818 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-125dfafe-362c-4d2d-8463-939201e2960f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:49.512417 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-125dfafe-362c-4d2d-8463-939201e2960f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:49.518881 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-125dfafe-362c-4d2d-8463-939201e2960f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:49.519367 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-125dfafe-362c-4d2d-8463-939201e2960f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:49.519771 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-125dfafe-362c-4d2d-8463-939201e2960f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:49.520444 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-125dfafe-362c-4d2d-8463-939201e2960f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:49.520887 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-125dfafe-362c-4d2d-8463-939201e2960f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:49.521297 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-125dfafe-362c-4d2d-8463-939201e2960f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:49.580429 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-125dfafe-362c-4d2d-8463-939201e2960f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:49.588086 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-125dfafe-362c-4d2d-8463-939201e2960f tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.080056 Aug 24 07:57:49.588645 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 645/1296] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:49 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:50.609668 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-9aba8a41-29ab-46f5-958c-22f6abd950a5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:50.610278 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-9aba8a41-29ab-46f5-958c-22f6abd950a5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:50.616753 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9aba8a41-29ab-46f5-958c-22f6abd950a5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:50.617234 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9aba8a41-29ab-46f5-958c-22f6abd950a5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:50.617665 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9aba8a41-29ab-46f5-958c-22f6abd950a5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:50.618360 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9aba8a41-29ab-46f5-958c-22f6abd950a5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:50.618845 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9aba8a41-29ab-46f5-958c-22f6abd950a5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:50.619267 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9aba8a41-29ab-46f5-958c-22f6abd950a5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:50.684010 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-9aba8a41-29ab-46f5-958c-22f6abd950a5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:50.692272 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-9aba8a41-29ab-46f5-958c-22f6abd950a5 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.087005 Aug 24 07:57:50.692879 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 652/1297] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:50 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:51.712762 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-fd026fe0-69c9-4917-9d3b-b5a3a255c06a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:51.713832 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-fd026fe0-69c9-4917-9d3b-b5a3a255c06a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:51.720217 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-fd026fe0-69c9-4917-9d3b-b5a3a255c06a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:51.720719 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-fd026fe0-69c9-4917-9d3b-b5a3a255c06a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:51.721145 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-fd026fe0-69c9-4917-9d3b-b5a3a255c06a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:51.721826 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-fd026fe0-69c9-4917-9d3b-b5a3a255c06a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:51.722271 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-fd026fe0-69c9-4917-9d3b-b5a3a255c06a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:51.722686 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-fd026fe0-69c9-4917-9d3b-b5a3a255c06a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:51.785668 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-fd026fe0-69c9-4917-9d3b-b5a3a255c06a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:51.793310 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-fd026fe0-69c9-4917-9d3b-b5a3a255c06a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.084439 Aug 24 07:57:51.793860 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 646/1298] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:51 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:52.815341 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-14a251b0-aaa1-4ae5-886d-70223140d191 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:52.815938 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-14a251b0-aaa1-4ae5-886d-70223140d191 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:52.822213 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-14a251b0-aaa1-4ae5-886d-70223140d191 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:52.822681 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-14a251b0-aaa1-4ae5-886d-70223140d191 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:52.823134 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-14a251b0-aaa1-4ae5-886d-70223140d191 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:52.823819 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-14a251b0-aaa1-4ae5-886d-70223140d191 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:52.824261 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-14a251b0-aaa1-4ae5-886d-70223140d191 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:52.824675 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-14a251b0-aaa1-4ae5-886d-70223140d191 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:52.886508 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-14a251b0-aaa1-4ae5-886d-70223140d191 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:52.894079 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-14a251b0-aaa1-4ae5-886d-70223140d191 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.083305 Aug 24 07:57:52.894659 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 653/1299] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:52 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:53.915948 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-7a563143-e302-4056-aeaa-565c66064207 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:53.916554 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-7a563143-e302-4056-aeaa-565c66064207 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:53.918916 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_api:SELECT=28 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:53.924995 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7a563143-e302-4056-aeaa-565c66064207 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:53.925494 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7a563143-e302-4056-aeaa-565c66064207 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:53.925922 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7a563143-e302-4056-aeaa-565c66064207 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:53.926741 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7a563143-e302-4056-aeaa-565c66064207 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:53.927214 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7a563143-e302-4056-aeaa-565c66064207 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:53.927627 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7a563143-e302-4056-aeaa-565c66064207 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:53.931861 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell1:SELECT=84 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:53.987183 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-7a563143-e302-4056-aeaa-565c66064207 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:53.994565 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-7a563143-e302-4056-aeaa-565c66064207 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.082598 Aug 24 07:57:53.995141 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 647/1300] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:53 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:55.016566 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-9d622b6b-ddca-4f5b-90f7-f589fa54af9b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:55.017298 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-9d622b6b-ddca-4f5b-90f7-f589fa54af9b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:55.019186 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_api:SELECT=28 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:55.024312 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9d622b6b-ddca-4f5b-90f7-f589fa54af9b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:55.024784 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9d622b6b-ddca-4f5b-90f7-f589fa54af9b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:55.025209 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9d622b6b-ddca-4f5b-90f7-f589fa54af9b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:55.025882 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9d622b6b-ddca-4f5b-90f7-f589fa54af9b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:55.026325 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9d622b6b-ddca-4f5b-90f7-f589fa54af9b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:55.026765 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-9d622b6b-ddca-4f5b-90f7-f589fa54af9b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:55.031261 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell1:SELECT=84 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:57:55.087687 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-9d622b6b-ddca-4f5b-90f7-f589fa54af9b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:55.096050 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-9d622b6b-ddca-4f5b-90f7-f589fa54af9b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.085280 Aug 24 07:57:55.096611 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 654/1301] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:55 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:56.116525 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-d1d37ca5-8495-4db2-b48c-1808d3a2081d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:56.117114 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-d1d37ca5-8495-4db2-b48c-1808d3a2081d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:56.123730 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d1d37ca5-8495-4db2-b48c-1808d3a2081d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:56.124219 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d1d37ca5-8495-4db2-b48c-1808d3a2081d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:56.124652 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d1d37ca5-8495-4db2-b48c-1808d3a2081d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:56.125380 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d1d37ca5-8495-4db2-b48c-1808d3a2081d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:56.125858 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d1d37ca5-8495-4db2-b48c-1808d3a2081d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:56.126282 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d1d37ca5-8495-4db2-b48c-1808d3a2081d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:56.188696 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-d1d37ca5-8495-4db2-b48c-1808d3a2081d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:56.196253 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-d1d37ca5-8495-4db2-b48c-1808d3a2081d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.083908 Aug 24 07:57:56.196813 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 648/1302] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:56 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:57.216663 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-7f9fbb93-caf9-47ec-a3e9-53b434b59049 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:57.217762 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-7f9fbb93-caf9-47ec-a3e9-53b434b59049 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:57.223888 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7f9fbb93-caf9-47ec-a3e9-53b434b59049 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:57.224364 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7f9fbb93-caf9-47ec-a3e9-53b434b59049 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:57.224799 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7f9fbb93-caf9-47ec-a3e9-53b434b59049 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:57.225482 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7f9fbb93-caf9-47ec-a3e9-53b434b59049 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:57.225932 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7f9fbb93-caf9-47ec-a3e9-53b434b59049 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:57.226356 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7f9fbb93-caf9-47ec-a3e9-53b434b59049 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:57.286357 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-7f9fbb93-caf9-47ec-a3e9-53b434b59049 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:57.293850 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-7f9fbb93-caf9-47ec-a3e9-53b434b59049 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.081106 Aug 24 07:57:57.294402 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 655/1303] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:57 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:58.314649 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-7b3be765-5ceb-4179-b412-3342930f5c58 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:58.315432 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-7b3be765-5ceb-4179-b412-3342930f5c58 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:58.322519 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7b3be765-5ceb-4179-b412-3342930f5c58 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:58.323020 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7b3be765-5ceb-4179-b412-3342930f5c58 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:58.323447 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7b3be765-5ceb-4179-b412-3342930f5c58 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:58.324125 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7b3be765-5ceb-4179-b412-3342930f5c58 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:58.324567 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7b3be765-5ceb-4179-b412-3342930f5c58 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:58.324979 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-7b3be765-5ceb-4179-b412-3342930f5c58 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:58.383820 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-7b3be765-5ceb-4179-b412-3342930f5c58 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:58.391668 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-7b3be765-5ceb-4179-b412-3342930f5c58 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.080899 Aug 24 07:57:58.392239 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 649/1304] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:58 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:57:59.412024 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-58497218-1018-4448-b59b-829ec028e400 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:57:59.412667 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-58497218-1018-4448-b59b-829ec028e400 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:57:59.419096 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-58497218-1018-4448-b59b-829ec028e400 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:59.419572 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-58497218-1018-4448-b59b-829ec028e400 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:59.420005 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-58497218-1018-4448-b59b-829ec028e400 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:59.420831 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-58497218-1018-4448-b59b-829ec028e400 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:57:59.421223 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-58497218-1018-4448-b59b-829ec028e400 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:57:59.421650 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-58497218-1018-4448-b59b-829ec028e400 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:57:59.485468 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-58497218-1018-4448-b59b-829ec028e400 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:57:59.493182 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-58497218-1018-4448-b59b-829ec028e400 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.085035 Aug 24 07:57:59.493781 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 656/1305] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:57:59 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:00.514815 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-efd03e53-a854-4894-a900-f89ce6ba2a69 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:00.515438 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-efd03e53-a854-4894-a900-f89ce6ba2a69 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:00.521457 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-efd03e53-a854-4894-a900-f89ce6ba2a69 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:00.521918 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-efd03e53-a854-4894-a900-f89ce6ba2a69 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:00.522337 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-efd03e53-a854-4894-a900-f89ce6ba2a69 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:00.523041 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-efd03e53-a854-4894-a900-f89ce6ba2a69 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:00.523483 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-efd03e53-a854-4894-a900-f89ce6ba2a69 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:00.523894 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-efd03e53-a854-4894-a900-f89ce6ba2a69 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:00.586571 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-efd03e53-a854-4894-a900-f89ce6ba2a69 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:00.594933 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-efd03e53-a854-4894-a900-f89ce6ba2a69 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.083969 Aug 24 07:58:00.595481 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 650/1306] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:00 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:01.615324 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-492ee10b-31af-4ea0-a7a9-ef15d4451d1b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:01.615941 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-492ee10b-31af-4ea0-a7a9-ef15d4451d1b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:01.622461 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-492ee10b-31af-4ea0-a7a9-ef15d4451d1b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:01.622964 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-492ee10b-31af-4ea0-a7a9-ef15d4451d1b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:01.623393 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-492ee10b-31af-4ea0-a7a9-ef15d4451d1b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:01.624075 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-492ee10b-31af-4ea0-a7a9-ef15d4451d1b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:01.624518 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-492ee10b-31af-4ea0-a7a9-ef15d4451d1b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:01.624939 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-492ee10b-31af-4ea0-a7a9-ef15d4451d1b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:01.683377 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-492ee10b-31af-4ea0-a7a9-ef15d4451d1b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:01.690810 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-492ee10b-31af-4ea0-a7a9-ef15d4451d1b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.079284 Aug 24 07:58:01.691366 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 657/1307] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:01 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:02.711118 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-21bca50d-1878-47c6-a0ef-dc08a25e4ea9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:02.711719 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-21bca50d-1878-47c6-a0ef-dc08a25e4ea9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:02.718760 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-21bca50d-1878-47c6-a0ef-dc08a25e4ea9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:02.719234 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-21bca50d-1878-47c6-a0ef-dc08a25e4ea9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:02.719659 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-21bca50d-1878-47c6-a0ef-dc08a25e4ea9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:02.720333 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-21bca50d-1878-47c6-a0ef-dc08a25e4ea9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:02.720774 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-21bca50d-1878-47c6-a0ef-dc08a25e4ea9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:02.721189 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-21bca50d-1878-47c6-a0ef-dc08a25e4ea9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:02.779145 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-21bca50d-1878-47c6-a0ef-dc08a25e4ea9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:02.787348 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-21bca50d-1878-47c6-a0ef-dc08a25e4ea9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.080061 Aug 24 07:58:02.787900 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 651/1308] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:02 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:03.808290 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-3945d461-8ace-4fc3-ad5d-1b2c12a56322 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:03.808903 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-3945d461-8ace-4fc3-ad5d-1b2c12a56322 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:03.815804 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3945d461-8ace-4fc3-ad5d-1b2c12a56322 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:03.816288 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3945d461-8ace-4fc3-ad5d-1b2c12a56322 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:03.816724 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3945d461-8ace-4fc3-ad5d-1b2c12a56322 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:03.817412 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3945d461-8ace-4fc3-ad5d-1b2c12a56322 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:03.817866 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3945d461-8ace-4fc3-ad5d-1b2c12a56322 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:03.818291 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3945d461-8ace-4fc3-ad5d-1b2c12a56322 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:03.877698 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-3945d461-8ace-4fc3-ad5d-1b2c12a56322 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:03.885350 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-3945d461-8ace-4fc3-ad5d-1b2c12a56322 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.081247 Aug 24 07:58:03.885907 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 658/1309] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:03 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:04.908084 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-c8e21634-22d7-43f4-b396-225b99305658 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:04.908712 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-c8e21634-22d7-43f4-b396-225b99305658 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:04.915290 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c8e21634-22d7-43f4-b396-225b99305658 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:04.915778 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c8e21634-22d7-43f4-b396-225b99305658 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:04.916215 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c8e21634-22d7-43f4-b396-225b99305658 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:04.916911 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c8e21634-22d7-43f4-b396-225b99305658 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:04.917365 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c8e21634-22d7-43f4-b396-225b99305658 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:04.917814 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c8e21634-22d7-43f4-b396-225b99305658 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:04.977382 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-c8e21634-22d7-43f4-b396-225b99305658 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:04.984891 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-c8e21634-22d7-43f4-b396-225b99305658 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.081317 Aug 24 07:58:04.985450 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 652/1310] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:04 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:06.005428 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-5f60a1fd-382a-4660-b43e-612ae147f74d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:06.006020 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-5f60a1fd-382a-4660-b43e-612ae147f74d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:06.012510 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5f60a1fd-382a-4660-b43e-612ae147f74d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:06.012984 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5f60a1fd-382a-4660-b43e-612ae147f74d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:06.013419 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5f60a1fd-382a-4660-b43e-612ae147f74d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:06.014887 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5f60a1fd-382a-4660-b43e-612ae147f74d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:06.015347 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5f60a1fd-382a-4660-b43e-612ae147f74d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:06.015768 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-5f60a1fd-382a-4660-b43e-612ae147f74d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:06.073702 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-5f60a1fd-382a-4660-b43e-612ae147f74d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:06.081834 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-5f60a1fd-382a-4660-b43e-612ae147f74d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.080362 Aug 24 07:58:06.082396 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 659/1311] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:06 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:07.102295 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-b53a03f1-89e6-4428-9049-11df2cd1dd67 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:07.102987 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-b53a03f1-89e6-4428-9049-11df2cd1dd67 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:07.109528 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b53a03f1-89e6-4428-9049-11df2cd1dd67 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:07.110003 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b53a03f1-89e6-4428-9049-11df2cd1dd67 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:07.110460 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b53a03f1-89e6-4428-9049-11df2cd1dd67 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:07.111174 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b53a03f1-89e6-4428-9049-11df2cd1dd67 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:07.111625 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b53a03f1-89e6-4428-9049-11df2cd1dd67 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:07.112044 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b53a03f1-89e6-4428-9049-11df2cd1dd67 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:07.172119 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-b53a03f1-89e6-4428-9049-11df2cd1dd67 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:07.179709 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-b53a03f1-89e6-4428-9049-11df2cd1dd67 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.081280 Aug 24 07:58:07.180272 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 653/1312] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:07 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:08.200191 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-150cf060-dbb6-4e55-b322-a0f5fe9fca8a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:08.200778 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-150cf060-dbb6-4e55-b322-a0f5fe9fca8a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:08.207716 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-150cf060-dbb6-4e55-b322-a0f5fe9fca8a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:08.208208 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-150cf060-dbb6-4e55-b322-a0f5fe9fca8a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:08.208633 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-150cf060-dbb6-4e55-b322-a0f5fe9fca8a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:08.209307 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-150cf060-dbb6-4e55-b322-a0f5fe9fca8a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:08.209755 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-150cf060-dbb6-4e55-b322-a0f5fe9fca8a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:08.210168 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-150cf060-dbb6-4e55-b322-a0f5fe9fca8a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:08.272749 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-150cf060-dbb6-4e55-b322-a0f5fe9fca8a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:08.280291 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-150cf060-dbb6-4e55-b322-a0f5fe9fca8a tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.083946 Aug 24 07:58:08.280841 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 660/1313] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:08 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:09.301192 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-1f6a3ceb-ae8b-48be-973d-5b688fa16859 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:09.301798 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-1f6a3ceb-ae8b-48be-973d-5b688fa16859 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:09.308476 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1f6a3ceb-ae8b-48be-973d-5b688fa16859 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:09.308944 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1f6a3ceb-ae8b-48be-973d-5b688fa16859 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:09.309367 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1f6a3ceb-ae8b-48be-973d-5b688fa16859 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:09.310041 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1f6a3ceb-ae8b-48be-973d-5b688fa16859 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:09.310480 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1f6a3ceb-ae8b-48be-973d-5b688fa16859 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:09.311586 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1f6a3ceb-ae8b-48be-973d-5b688fa16859 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:09.372148 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-1f6a3ceb-ae8b-48be-973d-5b688fa16859 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:09.380269 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-1f6a3ceb-ae8b-48be-973d-5b688fa16859 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.083012 Aug 24 07:58:09.380826 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 654/1314] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:09 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:10.400619 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-c62810f2-1c0b-4ee4-9bfa-affbfcd0d460 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:10.401249 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-c62810f2-1c0b-4ee4-9bfa-affbfcd0d460 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:10.407598 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c62810f2-1c0b-4ee4-9bfa-affbfcd0d460 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:10.408066 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c62810f2-1c0b-4ee4-9bfa-affbfcd0d460 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:10.408489 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c62810f2-1c0b-4ee4-9bfa-affbfcd0d460 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:10.409157 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c62810f2-1c0b-4ee4-9bfa-affbfcd0d460 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:10.409597 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c62810f2-1c0b-4ee4-9bfa-affbfcd0d460 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:10.410010 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c62810f2-1c0b-4ee4-9bfa-affbfcd0d460 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:10.468716 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-c62810f2-1c0b-4ee4-9bfa-affbfcd0d460 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:10.476123 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-c62810f2-1c0b-4ee4-9bfa-affbfcd0d460 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.079374 Aug 24 07:58:10.476681 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 661/1315] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:10 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:11.496351 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-0c2525d9-7656-43d7-8dd9-3a8b4dd09e17 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:11.496938 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-0c2525d9-7656-43d7-8dd9-3a8b4dd09e17 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:11.503714 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0c2525d9-7656-43d7-8dd9-3a8b4dd09e17 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:11.504190 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0c2525d9-7656-43d7-8dd9-3a8b4dd09e17 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:11.504620 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0c2525d9-7656-43d7-8dd9-3a8b4dd09e17 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:11.505301 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0c2525d9-7656-43d7-8dd9-3a8b4dd09e17 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:11.505748 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0c2525d9-7656-43d7-8dd9-3a8b4dd09e17 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:11.506166 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-0c2525d9-7656-43d7-8dd9-3a8b4dd09e17 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:11.565313 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-0c2525d9-7656-43d7-8dd9-3a8b4dd09e17 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:11.572813 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-0c2525d9-7656-43d7-8dd9-3a8b4dd09e17 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.080310 Aug 24 07:58:11.573363 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 655/1316] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:11 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:12.593881 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-40898a64-80a2-499f-a223-ec18e2c4d748 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:12.594485 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-40898a64-80a2-499f-a223-ec18e2c4d748 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:12.600876 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-40898a64-80a2-499f-a223-ec18e2c4d748 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:12.601346 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-40898a64-80a2-499f-a223-ec18e2c4d748 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:12.601770 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-40898a64-80a2-499f-a223-ec18e2c4d748 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:12.602443 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-40898a64-80a2-499f-a223-ec18e2c4d748 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:12.602937 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-40898a64-80a2-499f-a223-ec18e2c4d748 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:12.603352 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-40898a64-80a2-499f-a223-ec18e2c4d748 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:12.663242 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-40898a64-80a2-499f-a223-ec18e2c4d748 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:12.671385 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-40898a64-80a2-499f-a223-ec18e2c4d748 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.082063 Aug 24 07:58:12.671937 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 662/1317] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:12 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:13.692856 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-1af3fdca-2cb7-48c7-b64d-178be5349f12 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:13.693445 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-1af3fdca-2cb7-48c7-b64d-178be5349f12 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:13.699779 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1af3fdca-2cb7-48c7-b64d-178be5349f12 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:13.700249 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1af3fdca-2cb7-48c7-b64d-178be5349f12 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:13.700673 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1af3fdca-2cb7-48c7-b64d-178be5349f12 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:13.701353 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1af3fdca-2cb7-48c7-b64d-178be5349f12 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:13.702376 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1af3fdca-2cb7-48c7-b64d-178be5349f12 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:13.702814 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1af3fdca-2cb7-48c7-b64d-178be5349f12 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:13.761919 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-1af3fdca-2cb7-48c7-b64d-178be5349f12 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:13.770200 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-1af3fdca-2cb7-48c7-b64d-178be5349f12 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.080960 Aug 24 07:58:13.770766 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 656/1318] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:13 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:14.790611 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-d6e51551-26de-4a9f-b4ff-2bad8e8dcb66 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:14.791254 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-d6e51551-26de-4a9f-b4ff-2bad8e8dcb66 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:14.797602 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d6e51551-26de-4a9f-b4ff-2bad8e8dcb66 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:14.798071 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d6e51551-26de-4a9f-b4ff-2bad8e8dcb66 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:14.798496 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d6e51551-26de-4a9f-b4ff-2bad8e8dcb66 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:14.799207 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d6e51551-26de-4a9f-b4ff-2bad8e8dcb66 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:14.799654 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d6e51551-26de-4a9f-b4ff-2bad8e8dcb66 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:14.800067 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d6e51551-26de-4a9f-b4ff-2bad8e8dcb66 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:14.860320 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-d6e51551-26de-4a9f-b4ff-2bad8e8dcb66 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:14.867922 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-d6e51551-26de-4a9f-b4ff-2bad8e8dcb66 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.081160 Aug 24 07:58:14.868476 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 663/1319] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:14 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:15.889451 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-25525a75-4a4b-4859-90f4-01be60897de9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:15.890045 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-25525a75-4a4b-4859-90f4-01be60897de9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:15.896911 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-25525a75-4a4b-4859-90f4-01be60897de9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:15.897488 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-25525a75-4a4b-4859-90f4-01be60897de9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:15.897915 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-25525a75-4a4b-4859-90f4-01be60897de9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:15.898610 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-25525a75-4a4b-4859-90f4-01be60897de9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:15.899082 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-25525a75-4a4b-4859-90f4-01be60897de9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:15.899496 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-25525a75-4a4b-4859-90f4-01be60897de9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:15.961609 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-25525a75-4a4b-4859-90f4-01be60897de9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:15.969817 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-25525a75-4a4b-4859-90f4-01be60897de9 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.084467 Aug 24 07:58:15.970375 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 657/1320] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:15 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:16.990318 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-e8647cfc-7c72-4ab7-bfe0-61555e8ee051 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:16.990951 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-e8647cfc-7c72-4ab7-bfe0-61555e8ee051 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:16.997604 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e8647cfc-7c72-4ab7-bfe0-61555e8ee051 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:16.998081 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e8647cfc-7c72-4ab7-bfe0-61555e8ee051 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:16.998637 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e8647cfc-7c72-4ab7-bfe0-61555e8ee051 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:16.999853 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e8647cfc-7c72-4ab7-bfe0-61555e8ee051 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:17.000298 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e8647cfc-7c72-4ab7-bfe0-61555e8ee051 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:17.000711 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-e8647cfc-7c72-4ab7-bfe0-61555e8ee051 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:17.064547 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-e8647cfc-7c72-4ab7-bfe0-61555e8ee051 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:17.072506 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-e8647cfc-7c72-4ab7-bfe0-61555e8ee051 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.086011 Aug 24 07:58:17.073124 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 664/1321] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:16 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:18.095101 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-3866e7bc-6da4-4327-8c1a-500fdcff86b4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:18.095920 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-3866e7bc-6da4-4327-8c1a-500fdcff86b4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:18.102260 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3866e7bc-6da4-4327-8c1a-500fdcff86b4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:18.102753 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3866e7bc-6da4-4327-8c1a-500fdcff86b4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:18.103185 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3866e7bc-6da4-4327-8c1a-500fdcff86b4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:18.103879 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3866e7bc-6da4-4327-8c1a-500fdcff86b4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:18.104319 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3866e7bc-6da4-4327-8c1a-500fdcff86b4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:18.104737 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-3866e7bc-6da4-4327-8c1a-500fdcff86b4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:18.169101 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-3866e7bc-6da4-4327-8c1a-500fdcff86b4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:18.177554 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-3866e7bc-6da4-4327-8c1a-500fdcff86b4 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.086942 Aug 24 07:58:18.178127 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 658/1322] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:18 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:19.198901 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-b4d74775-5342-4a5b-86c5-4d58e884f376 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:19.199559 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-b4d74775-5342-4a5b-86c5-4d58e884f376 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:19.206483 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b4d74775-5342-4a5b-86c5-4d58e884f376 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:19.206995 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b4d74775-5342-4a5b-86c5-4d58e884f376 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:19.207461 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b4d74775-5342-4a5b-86c5-4d58e884f376 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:19.208169 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b4d74775-5342-4a5b-86c5-4d58e884f376 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:19.208615 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b4d74775-5342-4a5b-86c5-4d58e884f376 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:19.209028 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-b4d74775-5342-4a5b-86c5-4d58e884f376 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:19.275860 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-b4d74775-5342-4a5b-86c5-4d58e884f376 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:19.284274 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-b4d74775-5342-4a5b-86c5-4d58e884f376 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.089315 Aug 24 07:58:19.284870 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 665/1323] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:19 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:20.305528 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-d99f5939-0c1f-4058-8cb3-44e23e123301 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:20.306122 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-d99f5939-0c1f-4058-8cb3-44e23e123301 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:20.312743 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d99f5939-0c1f-4058-8cb3-44e23e123301 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:20.313230 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d99f5939-0c1f-4058-8cb3-44e23e123301 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:20.313656 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d99f5939-0c1f-4058-8cb3-44e23e123301 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:20.314329 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d99f5939-0c1f-4058-8cb3-44e23e123301 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:20.314797 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d99f5939-0c1f-4058-8cb3-44e23e123301 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:20.315212 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-d99f5939-0c1f-4058-8cb3-44e23e123301 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:20.375769 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-d99f5939-0c1f-4058-8cb3-44e23e123301 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:20.384056 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-d99f5939-0c1f-4058-8cb3-44e23e123301 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.082423 Aug 24 07:58:20.384611 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 659/1324] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:20 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:21.404503 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-be9cb235-8af1-47c2-bd45-d95f7d99a995 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:21.405133 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-be9cb235-8af1-47c2-bd45-d95f7d99a995 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:21.411511 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-be9cb235-8af1-47c2-bd45-d95f7d99a995 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:21.412159 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-be9cb235-8af1-47c2-bd45-d95f7d99a995 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:21.412420 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-be9cb235-8af1-47c2-bd45-d95f7d99a995 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:21.413113 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-be9cb235-8af1-47c2-bd45-d95f7d99a995 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:21.413562 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-be9cb235-8af1-47c2-bd45-d95f7d99a995 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:21.413987 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-be9cb235-8af1-47c2-bd45-d95f7d99a995 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:21.475305 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-be9cb235-8af1-47c2-bd45-d95f7d99a995 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:21.482976 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-be9cb235-8af1-47c2-bd45-d95f7d99a995 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.082355 Aug 24 07:58:21.483548 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 666/1325] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:21 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:22.504461 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-91a09e3f-5fe2-42bd-88fd-1888a0a528fb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:22.505064 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-91a09e3f-5fe2-42bd-88fd-1888a0a528fb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:22.511762 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-91a09e3f-5fe2-42bd-88fd-1888a0a528fb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:22.512242 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-91a09e3f-5fe2-42bd-88fd-1888a0a528fb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:22.512670 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-91a09e3f-5fe2-42bd-88fd-1888a0a528fb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:22.513361 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-91a09e3f-5fe2-42bd-88fd-1888a0a528fb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:22.513808 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-91a09e3f-5fe2-42bd-88fd-1888a0a528fb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:22.514228 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-91a09e3f-5fe2-42bd-88fd-1888a0a528fb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:22.580597 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-91a09e3f-5fe2-42bd-88fd-1888a0a528fb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:22.594420 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-91a09e3f-5fe2-42bd-88fd-1888a0a528fb tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.093995 Aug 24 07:58:22.595156 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 660/1326] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:22 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:23.615221 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-7e5c519b-70d9-4808-a706-1c0ea5c7d55e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:23.615869 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-7e5c519b-70d9-4808-a706-1c0ea5c7d55e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:23.622513 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7e5c519b-70d9-4808-a706-1c0ea5c7d55e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:23.623017 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7e5c519b-70d9-4808-a706-1c0ea5c7d55e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:23.623446 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7e5c519b-70d9-4808-a706-1c0ea5c7d55e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:23.624157 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7e5c519b-70d9-4808-a706-1c0ea5c7d55e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:23.624602 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7e5c519b-70d9-4808-a706-1c0ea5c7d55e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:23.625016 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-7e5c519b-70d9-4808-a706-1c0ea5c7d55e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:23.690359 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-7e5c519b-70d9-4808-a706-1c0ea5c7d55e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:23.698430 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-7e5c519b-70d9-4808-a706-1c0ea5c7d55e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.087031 Aug 24 07:58:23.699039 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 667/1327] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:23 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:24.721845 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-527546b6-8bc3-4f7b-87eb-0a84e4b9d56e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:24.722736 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-527546b6-8bc3-4f7b-87eb-0a84e4b9d56e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:24.724783 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_api:SELECT=28 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:24.730122 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-527546b6-8bc3-4f7b-87eb-0a84e4b9d56e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:24.730600 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-527546b6-8bc3-4f7b-87eb-0a84e4b9d56e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:24.731060 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-527546b6-8bc3-4f7b-87eb-0a84e4b9d56e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:24.731761 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-527546b6-8bc3-4f7b-87eb-0a84e4b9d56e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:24.732207 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-527546b6-8bc3-4f7b-87eb-0a84e4b9d56e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:24.732624 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-527546b6-8bc3-4f7b-87eb-0a84e4b9d56e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:24.735599 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG dbcounter [-] [127113] Writing DB stats nova_cell1:SELECT=84 {{(pid=127113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:24.795152 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-527546b6-8bc3-4f7b-87eb-0a84e4b9d56e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:24.803062 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-527546b6-8bc3-4f7b-87eb-0a84e4b9d56e tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.085093 Aug 24 07:58:24.803634 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 661/1328] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:24 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:25.824870 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-087486d0-0b52-4b54-8f3e-d925da019ab0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:25.825493 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-087486d0-0b52-4b54-8f3e-d925da019ab0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:25.827968 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_api:SELECT=28 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:25.834106 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-087486d0-0b52-4b54-8f3e-d925da019ab0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:25.834512 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-087486d0-0b52-4b54-8f3e-d925da019ab0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:25.835037 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-087486d0-0b52-4b54-8f3e-d925da019ab0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:25.835822 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-087486d0-0b52-4b54-8f3e-d925da019ab0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:25.836287 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-087486d0-0b52-4b54-8f3e-d925da019ab0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:25.836703 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-087486d0-0b52-4b54-8f3e-d925da019ab0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:25.840007 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG dbcounter [-] [127114] Writing DB stats nova_cell1:SELECT=84 {{(pid=127114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:58:25.905076 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-087486d0-0b52-4b54-8f3e-d925da019ab0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:25.913360 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-087486d0-0b52-4b54-8f3e-d925da019ab0 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.092449 Aug 24 07:58:25.913922 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 668/1329] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:25 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:26.934476 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-4d12ff0a-c23e-4563-bec1-9866fc24b587 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:26.935133 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-4d12ff0a-c23e-4563-bec1-9866fc24b587 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:26.941945 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4d12ff0a-c23e-4563-bec1-9866fc24b587 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:26.942427 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4d12ff0a-c23e-4563-bec1-9866fc24b587 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:26.942938 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4d12ff0a-c23e-4563-bec1-9866fc24b587 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:26.943683 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4d12ff0a-c23e-4563-bec1-9866fc24b587 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:26.944132 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4d12ff0a-c23e-4563-bec1-9866fc24b587 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:26.944558 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-4d12ff0a-c23e-4563-bec1-9866fc24b587 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:27.021164 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-4d12ff0a-c23e-4563-bec1-9866fc24b587 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:27.029842 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-4d12ff0a-c23e-4563-bec1-9866fc24b587 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.099424 Aug 24 07:58:27.030418 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 662/1330] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:26 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:28.050647 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-a7e418f9-8d4b-4de6-87c0-54025462671d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:28.051297 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-a7e418f9-8d4b-4de6-87c0-54025462671d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:28.057911 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a7e418f9-8d4b-4de6-87c0-54025462671d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:28.058369 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a7e418f9-8d4b-4de6-87c0-54025462671d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:28.059622 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a7e418f9-8d4b-4de6-87c0-54025462671d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:28.059622 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a7e418f9-8d4b-4de6-87c0-54025462671d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:28.059929 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a7e418f9-8d4b-4de6-87c0-54025462671d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:28.060347 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a7e418f9-8d4b-4de6-87c0-54025462671d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:28.125372 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-a7e418f9-8d4b-4de6-87c0-54025462671d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:28.135602 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-a7e418f9-8d4b-4de6-87c0-54025462671d tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.088882 Aug 24 07:58:28.136170 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 669/1331] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:28 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:29.157244 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-b01ae9af-5a04-4ba8-9e17-4336f6dad903 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:29.158078 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-b01ae9af-5a04-4ba8-9e17-4336f6dad903 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:29.164886 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b01ae9af-5a04-4ba8-9e17-4336f6dad903 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:29.165347 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b01ae9af-5a04-4ba8-9e17-4336f6dad903 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:29.165827 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b01ae9af-5a04-4ba8-9e17-4336f6dad903 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:29.166497 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b01ae9af-5a04-4ba8-9e17-4336f6dad903 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:29.166960 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b01ae9af-5a04-4ba8-9e17-4336f6dad903 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:29.167380 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-b01ae9af-5a04-4ba8-9e17-4336f6dad903 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:29.231388 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-b01ae9af-5a04-4ba8-9e17-4336f6dad903 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:29.239772 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-b01ae9af-5a04-4ba8-9e17-4336f6dad903 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.087013 Aug 24 07:58:29.240337 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 663/1332] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:29 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:30.260285 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-c38e18c2-da7a-4e24-9ea3-9a643ecbdd72 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:30.261209 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-c38e18c2-da7a-4e24-9ea3-9a643ecbdd72 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:30.268293 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c38e18c2-da7a-4e24-9ea3-9a643ecbdd72 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:30.268784 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c38e18c2-da7a-4e24-9ea3-9a643ecbdd72 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:30.269193 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c38e18c2-da7a-4e24-9ea3-9a643ecbdd72 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:30.269877 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c38e18c2-da7a-4e24-9ea3-9a643ecbdd72 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:30.270345 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c38e18c2-da7a-4e24-9ea3-9a643ecbdd72 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:30.270789 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-c38e18c2-da7a-4e24-9ea3-9a643ecbdd72 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:30.338204 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-c38e18c2-da7a-4e24-9ea3-9a643ecbdd72 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:30.350821 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-c38e18c2-da7a-4e24-9ea3-9a643ecbdd72 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.094373 Aug 24 07:58:30.351590 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 670/1333] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:30 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:31.372259 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-1b4e1b36-2483-4e3a-93e9-a84af7b7c454 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:31.372947 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-1b4e1b36-2483-4e3a-93e9-a84af7b7c454 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:31.379482 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1b4e1b36-2483-4e3a-93e9-a84af7b7c454 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:31.379967 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1b4e1b36-2483-4e3a-93e9-a84af7b7c454 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:31.380394 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1b4e1b36-2483-4e3a-93e9-a84af7b7c454 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:31.381082 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1b4e1b36-2483-4e3a-93e9-a84af7b7c454 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:31.381524 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1b4e1b36-2483-4e3a-93e9-a84af7b7c454 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:31.381940 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-1b4e1b36-2483-4e3a-93e9-a84af7b7c454 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:31.444482 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-1b4e1b36-2483-4e3a-93e9-a84af7b7c454 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:31.452703 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-1b4e1b36-2483-4e3a-93e9-a84af7b7c454 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.084431 Aug 24 07:58:31.453262 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 664/1334] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:31 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:32.473292 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-dea3b168-db1d-40a3-b8fc-7f8942c3a8b3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:32.474250 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-dea3b168-db1d-40a3-b8fc-7f8942c3a8b3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:32.480410 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-dea3b168-db1d-40a3-b8fc-7f8942c3a8b3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:32.480877 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-dea3b168-db1d-40a3-b8fc-7f8942c3a8b3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:32.481315 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-dea3b168-db1d-40a3-b8fc-7f8942c3a8b3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:32.482077 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-dea3b168-db1d-40a3-b8fc-7f8942c3a8b3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:32.482524 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-dea3b168-db1d-40a3-b8fc-7f8942c3a8b3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:32.482969 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-dea3b168-db1d-40a3-b8fc-7f8942c3a8b3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:32.544460 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-dea3b168-db1d-40a3-b8fc-7f8942c3a8b3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:32.552868 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-dea3b168-db1d-40a3-b8fc-7f8942c3a8b3 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.083451 Aug 24 07:58:32.553430 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 671/1335] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:32 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:32.890664 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 07:58:32.891843 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Wed Aug 24 07:58:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 07:58:33.574935 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-c910a943-d52e-4e3b-b85b-48bd7ceb2dec tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:33.575542 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-c910a943-d52e-4e3b-b85b-48bd7ceb2dec tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:33.582250 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c910a943-d52e-4e3b-b85b-48bd7ceb2dec tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:33.582758 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c910a943-d52e-4e3b-b85b-48bd7ceb2dec tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:33.583191 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c910a943-d52e-4e3b-b85b-48bd7ceb2dec tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:33.583896 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c910a943-d52e-4e3b-b85b-48bd7ceb2dec tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:33.584349 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c910a943-d52e-4e3b-b85b-48bd7ceb2dec tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:33.584771 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-c910a943-d52e-4e3b-b85b-48bd7ceb2dec tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:33.647845 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-c910a943-d52e-4e3b-b85b-48bd7ceb2dec tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:33.655618 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-c910a943-d52e-4e3b-b85b-48bd7ceb2dec tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.084641 Aug 24 07:58:33.656189 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 665/1336] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:33 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:58:34.679459 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-cbb7bb22-de9e-419a-b8bf-96094cb97d4b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:34.680096 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-cbb7bb22-de9e-419a-b8bf-96094cb97d4b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:34.686819 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cbb7bb22-de9e-419a-b8bf-96094cb97d4b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:34.687295 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cbb7bb22-de9e-419a-b8bf-96094cb97d4b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:34.687724 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cbb7bb22-de9e-419a-b8bf-96094cb97d4b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:34.688406 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cbb7bb22-de9e-419a-b8bf-96094cb97d4b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:34.688868 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cbb7bb22-de9e-419a-b8bf-96094cb97d4b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:34.689277 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-cbb7bb22-de9e-419a-b8bf-96094cb97d4b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:34.752580 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-cbb7bb22-de9e-419a-b8bf-96094cb97d4b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:34.760558 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-cbb7bb22-de9e-419a-b8bf-96094cb97d4b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.084989 Aug 24 07:58:34.761120 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 672/1337] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:34 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:35.781539 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-5d056a34-097f-4620-a502-4765ea61fb61 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:35.782304 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-5d056a34-097f-4620-a502-4765ea61fb61 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:35.788776 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5d056a34-097f-4620-a502-4765ea61fb61 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:35.789256 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5d056a34-097f-4620-a502-4765ea61fb61 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:35.789688 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5d056a34-097f-4620-a502-4765ea61fb61 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:35.790377 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5d056a34-097f-4620-a502-4765ea61fb61 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:35.790864 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5d056a34-097f-4620-a502-4765ea61fb61 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:35.791287 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-5d056a34-097f-4620-a502-4765ea61fb61 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:35.859472 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-5d056a34-097f-4620-a502-4765ea61fb61 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:35.869902 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-5d056a34-097f-4620-a502-4765ea61fb61 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.092235 Aug 24 07:58:35.870463 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 666/1338] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:35 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:58:36.890077 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-d0cdcebd-4624-4a47-b711-7a7b55cd5f7b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:36.890723 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-d0cdcebd-4624-4a47-b711-7a7b55cd5f7b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:36.897737 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d0cdcebd-4624-4a47-b711-7a7b55cd5f7b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:36.898212 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d0cdcebd-4624-4a47-b711-7a7b55cd5f7b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:36.898641 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d0cdcebd-4624-4a47-b711-7a7b55cd5f7b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:36.899347 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d0cdcebd-4624-4a47-b711-7a7b55cd5f7b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:36.899790 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d0cdcebd-4624-4a47-b711-7a7b55cd5f7b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:36.900203 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-d0cdcebd-4624-4a47-b711-7a7b55cd5f7b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:36.965281 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-d0cdcebd-4624-4a47-b711-7a7b55cd5f7b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:36.978087 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-d0cdcebd-4624-4a47-b711-7a7b55cd5f7b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.091581 Aug 24 07:58:36.979178 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 673/1339] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:36 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:38.000324 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-215493ed-a445-42f2-a512-db1c5c153bd8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:38.001127 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-215493ed-a445-42f2-a512-db1c5c153bd8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:38.011583 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-215493ed-a445-42f2-a512-db1c5c153bd8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:38.012067 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-215493ed-a445-42f2-a512-db1c5c153bd8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:38.012499 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-215493ed-a445-42f2-a512-db1c5c153bd8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:38.013186 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-215493ed-a445-42f2-a512-db1c5c153bd8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:38.013631 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-215493ed-a445-42f2-a512-db1c5c153bd8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:38.014047 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-215493ed-a445-42f2-a512-db1c5c153bd8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:38.078012 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-215493ed-a445-42f2-a512-db1c5c153bd8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:38.086459 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-215493ed-a445-42f2-a512-db1c5c153bd8 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.089841 Aug 24 07:58:38.091665 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 667/1340] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:37 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:39.110970 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-eab961ac-ab40-438e-a9b6-0233ab36bc8b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:39.111621 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-eab961ac-ab40-438e-a9b6-0233ab36bc8b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:39.118969 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-eab961ac-ab40-438e-a9b6-0233ab36bc8b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:39.119447 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-eab961ac-ab40-438e-a9b6-0233ab36bc8b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:39.119876 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-eab961ac-ab40-438e-a9b6-0233ab36bc8b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:39.120567 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-eab961ac-ab40-438e-a9b6-0233ab36bc8b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:39.121016 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-eab961ac-ab40-438e-a9b6-0233ab36bc8b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:39.121428 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-eab961ac-ab40-438e-a9b6-0233ab36bc8b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:39.191356 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-eab961ac-ab40-438e-a9b6-0233ab36bc8b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:39.199106 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-eab961ac-ab40-438e-a9b6-0233ab36bc8b tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.092040 Aug 24 07:58:39.199662 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 674/1341] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:39 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:40.220530 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-47f1c83f-d93c-4280-b88a-b1afa6f12c54 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:40.221455 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-47f1c83f-d93c-4280-b88a-b1afa6f12c54 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:40.227853 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-47f1c83f-d93c-4280-b88a-b1afa6f12c54 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:40.228327 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-47f1c83f-d93c-4280-b88a-b1afa6f12c54 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:40.228758 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-47f1c83f-d93c-4280-b88a-b1afa6f12c54 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:40.229447 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-47f1c83f-d93c-4280-b88a-b1afa6f12c54 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:40.229896 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-47f1c83f-d93c-4280-b88a-b1afa6f12c54 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:40.230320 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-47f1c83f-d93c-4280-b88a-b1afa6f12c54 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:40.292764 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.policy [None req-47f1c83f-d93c-4280-b88a-b1afa6f12c54 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127113) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:40.302291 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-47f1c83f-d93c-4280-b88a-b1afa6f12c54 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.085415 Aug 24 07:58:40.303124 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 668/1342] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:40 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:41.219878 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 07:58:41.220157 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Wed Aug 24 07:58:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 07:58:41.324471 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-a07d2708-4152-4454-806c-cbd09dd2f270 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:41.325853 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-a07d2708-4152-4454-806c-cbd09dd2f270 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:41.332157 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a07d2708-4152-4454-806c-cbd09dd2f270 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:41.332628 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a07d2708-4152-4454-806c-cbd09dd2f270 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:41.333057 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a07d2708-4152-4454-806c-cbd09dd2f270 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:41.333738 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a07d2708-4152-4454-806c-cbd09dd2f270 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:41.334188 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a07d2708-4152-4454-806c-cbd09dd2f270 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:41.334604 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-a07d2708-4152-4454-806c-cbd09dd2f270 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:41.397638 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.policy [None req-a07d2708-4152-4454-806c-cbd09dd2f270 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48f23faea87840ecbf5b75753eb1d139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8a466e6a44ceb989ba40e429c625e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127114) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:58:41.405375 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-a07d2708-4152-4454-806c-cbd09dd2f270 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 200 len: 1261 microversion: 2.1 time: 0.084787 Aug 24 07:58:41.405935 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 675/1343] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:41 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 1261 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:58:41.425096 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-93131dab-4a3b-40fc-9fa3-515743f30fca tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:41.425677 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-93131dab-4a3b-40fc-9fa3-515743f30fca tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127113) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:41.432842 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-93131dab-4a3b-40fc-9fa3-515743f30fca tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:41.433313 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-93131dab-4a3b-40fc-9fa3-515743f30fca tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:41.433733 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-93131dab-4a3b-40fc-9fa3-515743f30fca tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:41.434495 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-93131dab-4a3b-40fc-9fa3-515743f30fca tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:41.434928 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-93131dab-4a3b-40fc-9fa3-515743f30fca tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:41.435504 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-93131dab-4a3b-40fc-9fa3-515743f30fca tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:41.460583 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.compute.api [None req-93131dab-4a3b-40fc-9fa3-515743f30fca tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Going to try to terminate instance {{(pid=127113) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 07:58:41.469997 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-93131dab-4a3b-40fc-9fa3-515743f30fca tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:41.470385 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-93131dab-4a3b-40fc-9fa3-515743f30fca tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:41.470846 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG oslo_concurrency.lockutils [None req-93131dab-4a3b-40fc-9fa3-515743f30fca tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:41.515617 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.objects.instance [None req-93131dab-4a3b-40fc-9fa3-515743f30fca tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lazy-loading 'flavor' on Instance uuid 393b389b-1654-482f-a1e7-065d4b77acde {{(pid=127113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:58:41.527153 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.objects.instance [None req-93131dab-4a3b-40fc-9fa3-515743f30fca tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lazy-loading 'system_metadata' on Instance uuid 393b389b-1654-482f-a1e7-065d4b77acde {{(pid=127113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:58:41.576319 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.objects.instance [None req-93131dab-4a3b-40fc-9fa3-515743f30fca tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lazy-loading 'metadata' on Instance uuid 393b389b-1654-482f-a1e7-065d4b77acde {{(pid=127113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:58:41.580381 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 07:58:41.580562 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Wed Aug 24 07:58:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 07:58:41.964806 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.scheduler.client.report [None req-93131dab-4a3b-40fc-9fa3-515743f30fca tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Deleted allocations for instance 393b389b-1654-482f-a1e7-065d4b77acde Aug 24 07:58:41.982990 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-93131dab-4a3b-40fc-9fa3-515743f30fca tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "DELETE /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 204 len: 0 microversion: 2.1 time: 0.562049 Aug 24 07:58:41.983545 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 669/1344] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Aug 24 07:58:41 2022] DELETE /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 0 bytes in 563 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 07:58:41.992525 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-3362fdac-e225-4759-9643-3953c4e3fb86 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '>' {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:41.993137 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.compute.api [None req-3362fdac-e225-4759-9643-3953c4e3fb86 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] [instance: 393b389b-1654-482f-a1e7-065d4b77acde] Fetching instance by UUID {{(pid=127114) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:58:41.999323 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3362fdac-e225-4759-9643-3953c4e3fb86 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:41.999796 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3362fdac-e225-4759-9643-3953c4e3fb86 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:42.000225 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3362fdac-e225-4759-9643-3953c4e3fb86 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:42.000907 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3362fdac-e225-4759-9643-3953c4e3fb86 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Acquiring lock "25bce80b-e624-439b-a839-ab618d931874" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:58:42.001355 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3362fdac-e225-4759-9643-3953c4e3fb86 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:58:42.001774 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG oslo_concurrency.lockutils [None req-3362fdac-e225-4759-9643-3953c4e3fb86 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Lock "25bce80b-e624-439b-a839-ab618d931874" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:58:42.015325 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.wsgi [None req-3362fdac-e225-4759-9643-3953c4e3fb86 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] HTTP exception thrown: Instance 393b389b-1654-482f-a1e7-065d4b77acde could not be found. Aug 24 07:58:42.016863 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-3362fdac-e225-4759-9643-3953c4e3fb86 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Request method failure captured: Aug 24 07:58:42.016863 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: request: GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde HTTP/1.1 Aug 24 07:58:42.016863 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept: application/json Aug 24 07:58:42.016863 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Accept-Encoding: identity Aug 24 07:58:42.016863 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Connection: close Aug 24 07:58:42.016863 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Length: 0 Aug 24 07:58:42.016863 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Content-Type: application/json Aug 24 07:58:42.016863 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Host: 10.222.0.42 Aug 24 07:58:42.016863 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Openstack-System-Scope: None Aug 24 07:58:42.016863 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: User-Agent: python-urllib3/1.26.11 Aug 24 07:58:42.016863 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Auth-Token: gAAAAABjBdi5hYJuvo8oBqUH52q_rQbUwwrmU0EaA6K6KPeIT4UqZaL3h9dUoq1Q5u4FL-kHz21ELWVGJuOJg6CAga2UXwfgv222d9G24xD8ncQ3zFr1h17xSaGu-HJID_7SFsMNky4dLKfYhKu9_A5nqwqsxjN3X0GV2ynvEM3zpZXqzDmejxk Aug 24 07:58:42.016863 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Id: None Aug 24 07:58:42.016863 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Domain-Name: None Aug 24 07:58:42.016863 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Identity-Status: Confirmed Aug 24 07:58:42.016863 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Is-Admin-Project: True Aug 24 07:58:42.016863 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Id: default Aug 24 07:58:42.016863 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Domain-Name: Default Aug 24 07:58:42.016863 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Id: f6a8a466e6a44ceb989ba40e429c625e Aug 24 07:58:42.016863 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Project-Name: tempest-TestMinimumBasicScenario-1668397230 Aug 24 07:58:42.016863 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Role: reader,member Aug 24 07:58:42.016863 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Roles: reader,member Aug 24 07:58:42.018775 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f6a8a466e6a44ceb989ba40e429c625e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f6a8a466e6a44ceb989ba40e429c625e", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f6a8a466e6a44ceb989ba40e429c625e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f6a8a466e6a44ceb989ba40e429c625e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}] Aug 24 07:58:42.018775 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant: tempest-TestMinimumBasicScenario-1668397230 Aug 24 07:58:42.018775 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Id: f6a8a466e6a44ceb989ba40e429c625e Aug 24 07:58:42.018775 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1668397230 Aug 24 07:58:42.018775 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User: tempest-TestMinimumBasicScenario-1668397230-project Aug 24 07:58:42.018775 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Id: default Aug 24 07:58:42.018775 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Domain-Name: Default Aug 24 07:58:42.018775 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Id: 48f23faea87840ecbf5b75753eb1d139 Aug 24 07:58:42.018775 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: X-User-Name: tempest-TestMinimumBasicScenario-1668397230-project Aug 24 07:58:42.018775 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: method: > Aug 24 07:58:42.018775 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: exception: Instance 393b389b-1654-482f-a1e7-065d4b77acde could not be found. Aug 24 07:58:42.018775 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: action_args: {'id': '393b389b-1654-482f-a1e7-065d4b77acde'} Aug 24 07:58:42.019797 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: {{(pid=127114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:58:42.019797 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:58:42.019797 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:58:42.019797 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:58:42.019797 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:58:42.019797 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:58:42.019797 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:58:42.019797 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:58:42.019797 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:58:42.019797 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:58:42.019797 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 393b389b-1654-482f-a1e7-065d4b77acde could not be found. Aug 24 07:58:42.019797 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:58:42.019797 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:58:42.019797 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:58:42.019797 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:58:42.019797 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:58:42.019797 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:58:42.019797 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:58:42.019797 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:58:42.019797 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:58:42.021456 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:58:42.021456 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 07:58:42.021456 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 07:58:42.021456 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:58:42.021456 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:58:42.021456 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:58:42.021456 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:58:42.021456 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 393b389b-1654-482f-a1e7-065d4b77acde could not be found. Aug 24 07:58:42.021456 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:58:42.021456 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:58:42.021456 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:58:42.021456 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:58:42.021456 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:58:42.021456 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:58:42.021456 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:58:42.021456 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:58:42.021456 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 393b389b-1654-482f-a1e7-065d4b77acde could not be found. Aug 24 07:58:42.021456 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: ERROR nova.api.openstack.wsgi Aug 24 07:58:42.022942 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: DEBUG nova.api.openstack.wsgi [None req-3362fdac-e225-4759-9643-3953c4e3fb86 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Returning 404 to user: Instance 393b389b-1654-482f-a1e7-065d4b77acde could not be found. {{(pid=127114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:58:42.022942 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO nova.api.openstack.requestlog [None req-3362fdac-e225-4759-9643-3953c4e3fb86 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde" status: 404 len: 111 microversion: 2.1 time: 0.029644 Aug 24 07:58:42.022942 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: [pid: 127114|app: 0|req: 676/1345] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Aug 24 07:58:41 2022] GET /compute/v2.1/servers/393b389b-1654-482f-a1e7-065d4b77acde => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 07:58:42.029835 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: DEBUG nova.api.openstack.wsgi [None req-a06bb905-71ea-45cf-9c91-9acea264e026 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] Calling method '.version_select at 0x7faf5beae5e0>' {{(pid=127113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:58:42.059158 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO nova.api.openstack.requestlog [None req-a06bb905-71ea-45cf-9c91-9acea264e026 tempest-TestMinimumBasicScenario-1668397230 tempest-TestMinimumBasicScenario-1668397230-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-200319513" status: 202 len: 0 microversion: 2.1 time: 0.033766 Aug 24 07:58:42.059727 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: [pid: 127113|app: 0|req: 670/1346] 10.222.0.42 () {58 vars in 1269 bytes} [Wed Aug 24 07:58:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-200319513 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 07:58:56.222284 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 07:58:56.222890 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Wed Aug 24 07:58:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 07:58:57.527978 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 07:58:57.528582 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Wed Aug 24 07:58:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 07:59:49.306224 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 07:59:49.306793 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Wed Aug 24 07:59:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:01:52.901310 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:01:52.901949 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Wed Aug 24 08:01:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:02:01.228334 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:02:01.229017 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Wed Aug 24 08:02:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:02:01.589908 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:02:01.590342 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Wed Aug 24 08:02:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:02:16.231120 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:02:16.231815 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Wed Aug 24 08:02:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:02:17.536461 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:02:17.537069 dv-cinder-854273-1-iscsi devstack@n-api.service[127113]: Wed Aug 24 08:02:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 08:03:09.315216 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 08:03:09.315845 dv-cinder-854273-1-iscsi devstack@n-api.service[127114]: Wed Aug 24 08:03:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!